This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
Internationa) Bureau 



mm 
Ire 



PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(30) Priority Data: 






6<Y053,330 


21 July 1997 (21.07.97) 


US 


60/055,237 


12 August 1997 (12.08.97) 


US 


60/055,761 


14 August 1997 (14.08.97) 


US 


60/061,119 


6 October 1997(06.10.97) 


US 


60/068,375 


22 December 1997 (22.12.97) 


US 


60/071,811 


20 January 1998 (20.01.98) 


us 


60/071,812 


20 January 1998 (20.01.98) 


us 


60/071,882 


20 January 1998 (20.01,98) 


us 



(51) International Patent ClassiGcation 6 : 
H04N 5/50, 5/445 



Al 



(11) International Publication Number: WO 99/04561 

(43) International Publication Date: 28 January 1999 (28.01.99) 



(21) International Application Number: PCT/US98/1 5093 

(22) International Filing Date: 21 July 1998 (21.07.98) 



(71) Applicant (for all designated States except US): E-GUIDE, 

INC. [US/USJ; Suite 870, 135 North Los Robles Avenue, 
Pasadena, CA 91 101 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): ALEXANDER, Ron 
[US/US]; 209 Burlington Road, Bedford, Ma 01730 (US). 
DIAS, Steve [US/USJ; 23 Norfolk Place, Sharon, MA 
01730 (US). HANCOCK, Ken [US/US]; 64 Stillwater 
Drive, Nashua, NH 03062 (US). LEUNG, Elsie, Y. 
[US/US]; 1302 Via Del Ray, South Pasadena, CA 91030 
(US). MACRAE, Douglas [US/US]; 209 Burlington 



Road, Bedford, MA 01730 (US). NG, Art [US/US]; 209 
Burlington Road, Bedford, MA 01730 (US). O'NEIL, 
Sean [US/US]; 209 Burlington Road, Bedford, MA 01730 
(US). SCHOAFF, P., Christopher [US/US]; 1 Sweetwood 
Circle, Westford, MA 01886 (US). SUTTON, Jon [US/US]; 
209 Burlington Road, Bedford, MA 01730 (US). WARD, 
Thomas, E. [US/USJ; 3 Viles Street, Weston, MA 02193 
(US). WESTBERG, Tom [US/USJ; 209 Burlington Road, 
Bedford, MA 01730 (US). YUEN, Henry, C. [US/US]; 
P.O. Box 1159, Redondo Beach, CA 90278 (US). 

(74) Agent: RAHN, LeRoy, T.; Christie, Parker & Hale, LLP, P.O. 
Box 7068, Pasadena, CA 91109-7068 (US). 



(81) Designated States: AL, AM, AT, AU, AZ, BA, BB, BG, BR, 
BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GE, 
GH, GM, HR, HU, ID, IL, IS, JP, KE, KG, KP, KR, KZ, 
LC, LK, LR, LS, LT, LU, LV, MD, MG, MK, MN, MW, 
MX, NO, NZ, PL, PT, RO, RU, SD, SE t SG, SI, SK, SL, 
TJ, TM, TR, TT, UA, UG, US, UZ, VN, YU, ZW, ARIPO 
patent (GH, GM, KE, LS, MW, SD, SZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, 
IE, IT, LU, MC, NL, PT, SE), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: SYSTEMS AND METHODS FOR DISPLAYING AND RECORDING CONTROL INTERFACES 



44 



12 



14 



16 



10-.03PU 
yocd n* LAST 



©wwdom 

DEftAKNKin 



» TOOK 2 
ogpuctk rwo. » 



O WATCH 



46 



r 



10 



18 



FfilCISCtM: SAM DONALDSON MTIKVCWS 
TWO OF GOSPEL WUSCS PtOKECRS. Mff GRANT 
MO SAND! PATTY. 

*ac(i}) *oopu<it) cc ■ 

sow \ soom i itcsswcl \ 



w I 



mom 



I 



t:J0PU 



II II — — 



24 
20 



52 

1/ 



22 



(57) Abstract 

The present invention is an improvement over previous electronic programming guides "EPG" in that it provides, among other things: 
improved viewer interaction capabilities with the EPG; improved viewer control of video recording (46) of future-scheduled programming; 
improved features of the EPG display and navigation (10); parental control of the EPG display; improved television program access by 
the viewer (22); improved product opportunities for the commercial advertiser to reach the viewer's profile (14, 16); improved products 
information access by the viewer (12); creation of the viewer's profile (36, 52); utilization of the viewer profile information to customize 
various aspects of the EPG (24); and utilization of viewer profile information to provide the customized presentation of advertising to the 
viewer (24). 
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SYSTEMS AND METHODS FOR DISPLAYING AND RECORDING CONTROL INTERFACES 



FIELD OF THE INVENTION 

j The present invention relates generally to television systems, and more particularly, 
to the display of, and recording control interface with, television programs, video, advertising 
information and program scheduling information. 

BACKGROUND OF THE INVENTION 

Television viewers have historically analyzed the information provided by television 
program schedule guides to select television programs to watch. Historically, television 
program schedule guides have listed the available television programs by day of the week, 
time of day, channel, and program title. Historically, only hardcopy television program 
schedule guides were available. More recently, as illustrated by the Levine Patent, U.S. 
Patent No. 4,908,713, television program guides have become available in electronic form. 
The earliest versions of on-screen electronic program guides ("EPG") provided for the storage 
of program schedule information in an electronic memory connected to the television receiver 
and generally provided for the on-screen formatting and display of the program schedule 
information on the television screen. The early EPGs typically overlaid the television 
programming. Furthermore, viewer interaction capabilities with early EPGs was extremely 
limited. 

Later EPGs provided viewer-to-EPG interaction improvements and provided Picture- 
In-Guide ("PIG") display of the television program simultaneous with the display of the EPG. 
International Application No. PCT/US95/11173 (International Publication No. WO 
96/07270), the disclosure of which is incorporated by reference herein for all purposes, 
illustrates such an improvement. 

SUMMARY OF THE INVENTION 

The present invention is an improvement over previous EPGs in that it provides, 
among other things: 

A. Improved viewer interaction capabilities with the EPG; 

B. Improved viewer control of video recording of future-scheduled programming; 

C. Improved features to the EPG display and navigation; 
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D. Parental control of the EPG display; 

E. Improved television program information access by the viewer; 

5 F. Improved opportunities for the commercial advertiser to reach the viewer; 

G. Improved product information access by the viewer; 

H. Creation of a viewer's profile; 

I. Utilization of viewer profile information to customize various aspects of the EPG; 
and J. Utilization of viewer profile information to provide customized presentation 

1 o of advertising to the viewer. 

DESCRIPTION OF THE DRAWINGS 

These and other features, aspects, and advantages of the present invention will become 
better understood with regard to the following description, appended claims, and 
15 accompanying drawings where: 

FIG.l is a graphic representation of a sample screen display of the EPG. 
FIG.2 is a drawing of a portion of a remote control device that shows keys for 
activating various functions of the EPG. 

FIG. 3 is a graphic representation of a sample on screen EPG display depicting the 
20 EPG's on-screen Grid Guide in the programming scrolling mode. 

FIGS. 4a and 4b is a graphic representation of a sample on screen EPG display 
depicting the EPG's on-screen Grid Guide in the channel-scrolling. 

FIG. 5 is a graphic representation of a sample on screen EPG display depicting the 
EPG in the Watch Scheduling Function. 
25 FIG. 6 is a graphic representation of a sample on screen EPG display depicting the 

Watch/Record Schedule screen of the EPG. 

FIG. 7 is a graphic representation of a sample on screen EPG display depicting the top 
level theme screen display of the EPG. 

FIG. 8 is a graphic representation of a sample on screen EPG display depicting the 
30 second-level theme screen display of the EPG. 

FIG. 9 is a graphic representation of a sample on screen EPG display depicting the 
Channel Guide function of the EPG. 

FIGS. 10a and 10b are graphic representations of sample on screen EPG displays 
depicting one embodiment of the feature of presenting additional information concerning the 
35 subject matter of a highlighted Panel Ad Window. ^ 

\ . - . ... 
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* 

DETAILED DESCRIPTION OF THE INVENTION * " 

The disclosure of International Application WO96/07270, published on March 7, 

5 1996 is incorporated fully herein by reference. The present invention is an improvement on 
the electronic program guide- (EPG) disclosed therein. The apparatus disclosed in the 
referenced PCT application is used to generate the screen displays described below. 

In FIG; 1 of the drawing, one embodiment of the EPG with Ad Window and 
Advertising Messages is shown. In FIG. 1, a television screen display 10 is shown. Display 

10 10 could be generated by a conventional television receiver with interlaced scan lines, by a 
VCR, by a PC monitor with progressive scan lines, or by another other type of video display 
device. In the upper left hand corner of the screen is a PIP window 1 2. Below window 1 2 are 
Panel Ad Windows 14, and 16 ("Ad Windows"). Windows 12, 14, and 16 each typically 
occupy about 1/9 of the total screen area. The remainder of the screen area is typically 

1 5 occupied (moving from top to bottom of the screen) by an action key bar 1 8, a navigation bar 
20, a grid guide 22 ("Grid Guide"), and an information box 24 (the "detailed information 
area). 

In FIG. 2 of the drawing, one embodiment of a remote controller 26 for activating the 
functions of display 10 is shown. Remote controller 26 could have other keys for activating 

20 the functions of a user video device, such as a television receiver, a VCR, or a cable box. 
Remote control 26 has up, down, right, and left arrows keys 28, 30, 32, and 34, respectively, 
for controlling the movement of a cursor 36 on display 10. Cursor 36 can select, i.e., 
highlight, any of windows 12, 14, or 16 by pressing arrow keys 28 to 34, any of the titles and 
channels in Grid Guide 22 by pressing arrow keys 32 and 34, or navigation bar 20 by pressing 

25 arrow keys 32 and 34. Windows 12, 14, and 16 are highlighted by adding a border around 
the window or changing the color of the border, if the border is permanent. The titles and 
channels in Grid Guide 22 and navigation bar 20 are highlighted by changing color. 

Highlighting of windows and/or viewer selections from the Grid Guide and/or 
navigation and EPG on screen display components may be accomplished in a number of other 

30 ways. For instance, the border of a selected window, or the selected Grid Guide or navigation 
component, can be made to appear to flash. Another way to highlight a viewer selection is 
to make the selected window or feature appear to become brighter than the rest of the on 
screen display. Yet another way to highlight a viewer selection is to blur all portions of the 
on screen display, except for the viewer selected component. Still another way to highlight 

35 a viewer selection is to make all portions of the on screen display, except for the viewer 
selected component, appear transparent. Still yet another way to highlight a viewer selection 
is to add animation to the selected component. When a portion of the EPG is selected, the 
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1 - 

system issues graphic display commands to the on screen display (OSD) controller to 
implement one or more of the desired enhancement technique(s). 

5 The viewer enters the Guide Mode illustrated in FIG. 1 by pressing a "guide" key 35 

and returns to the full screen Television Mode by pressing key 35 again or by pressing the 
"select" key. A real time television program is displayed in window 12. A translucent 
overlay of the PIP Window 12 can displays the title, channel (local number and/or station 
name), and status (locked or unlocked) of window 12 over the television program so the 

1 o viewer can still see the entire image. 

The PIP Window can be locked or unlocked. The "lock/unlock" function is user 
controlled. To lock or unlock the PIP Window, the viewer can use a PIP button on the remote 
control device, or can highlight and press the Lock/Unlock EPG action button. The 
lock/unlock status is recorded and maintained until the status is reset by the viewer. That is, 

1 5 the lock/unlock status for the PIP Window in the EPG is maintained when the viewer leaves 
the Guide and later re-enters the Guide, including when the viewer turns off the television. 
If the viewer selects the "lock" status, the last channel to which the tuner was set in the PIP 
Window continues to be displayed regardless of the actions exercised by the viewer. In the 
unlocked status, the channel highlighted by cursor 36 in Grid Guide 22 is displayed if the 

20 Grid Guide is displaying currently telecast programs and the last currently telecast channel 
that was highlighted is displayed if the Grid Guide is displaying future programs. 

There are generally three results to leaving the Guide, depending upon the way the 
viewer leaves the Guide. If the viewer, while in the EPG, wants to watch in fiill screen mode 
the program shown in the PIP Window, then the viewer can press the Guide button on the 

25 remote control device. If the viewer, while in the EPG, highlights a particular channel in the 
Grid Guide, and then presses the "select" button, the viewer will leave the Guide to view in 
the full screen mode the television program that the viewer highlighted in the Guide. If the 
viewer, while in the EPG, presses the "clear" or "cancel" button on the remote control device, 
then the viewer will leave the Guide and return to the television program that the viewer was 

30 watching immediately before entering the Guide. 

Typically, an ad for a future telecast program is displayed in window 14. This ad is 
linked to the time and channel of the program in RAM so the viewer can watch or record the 
program automatically by pressing the blue left action button to watch the program, or the 
green right action button to record the program. 

35 Typically, an ad for a product or service is displayed in window 16. This ad is linked 

to more information about the product or service in RAM so the viewer can read one or more 
pages about the product or service in window 16 by pressing an "info" key 40 one or more 
times. Alternatively, this ad is linked to the time and channel in RAM that an infomercial 
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about the product or service will be telecast so the viewer can watch or record the infomercial 
automatically by pressing "select" key 42. 
5 Bar 18 displays a blue button 44 and/or a green button 46 with legends that depend 

upon the context of the information displayed on the screen. Remote controller 26 has 
corresponding keys 48 and 50, respectively, to activate the functions represented by blocks 
44 and 46. 

From window 12, 14, or 16 the viewer moves to grid guide 22 by pressing arrow key 
10 32. (From grid guide 22 the viewer moves to window 12, 14, or 16 by pressing arrow key 
34.) In grid guide 22 the viewer moves cursor 36 to highlight one of the nine tiles in which 
channel and title are displayed by pressing arrow keys 28 and 30. The viewer can view 
program listings scheduled at future times by pressing keys 32 or 34 to move horizontally 
about the Grid. 

1 5 From grid guide 22 the viewer moves to navigation bar 20 by pressing arrow key 28. 

Initially, the center button is highlighted. To highlight a different button, arrow key 32 or 34 
is pressed. To enter the screen represented by the highlighted button, "select" key 42 is 
pressed. 

In grid guide 22 details about the program represented by the highlighted tile are 

20 displayed. If more information is available this fact is indicated by an icon and such 
information is displayed in the area occupied by grid guide 22, instead of the grid guide by 
pressing "info" key 40. To return to the grid guide, "info" key 40 is pressed again. After an 
action button has been pressed or an icon on navigation bar 20 has been activated, an 
instructional prompt may be substituted for the program information in information box 24. 

25 In addition to the tiles representing television programs, a virtual channel ad can be 

displayed in grid guide 22 on a tile 52. A virtual channel ad may promote, for instance, a 
current or future television program. Such a virtual channel ad for a television program is 
linked to the time and channel of the program in RAM so the viewer can watch or record the 
program automatically by pressing "select" key 42 in the manner described in the referenced 

30 application. More than one virtual channel ad may be stored in RAM, but preferably only one 
such ad is displayed at a time. 

Reference is made to the TV Guide Plus+ 98 User Interface Specification vl ,42stv, 
which is attached hereto as Appendix A, the disclosure of which is incorporated by reference 
as if fully stated herein, for more description of the invention. 

35 One embodiment of the hardware for this invention includes a circuit board consisting 

of a gate array that provides all of the control functions for access by the processor (e.g., 
Motorola 68000), control of memory (dynamic RAM and external ROM), and some 
peripheral functions such as infrared ("IR") input and output, frequency synthesizer for the 
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paging system, and data acquisition from the paging system. Inside there is a module for 
creating an on-screen display including a programmable DMA (direct memory access) 

5 controller, a color lookup table that provides for a field called a color index that can be used 
to select a more complicated color (more bits than can be expressed in the bit map), first-in- 
first-out ("FIFO") memory for ordering the pixels (which allows the system to write the 
pixels as fast as the system is capable of writing the pixels and then sending the pixels to the 
display according to a prescribed timing. Included in the chip is a timing subsystem that 

10 produces a number of different timing signals of varying frequency-from clocks to long 
millisecond time measurement, and interrupts. Synchronization signals for the television 
monitor are also generated by the internal timing subsystem. The system also typically 
includes circuits for functions including but not limited to: data receiver, memory controller, 
timing interface with the processor, data deinterleaving, error correcting, and synchronous 

1 5 timing generator with horizontal and vertical counters. 

Another feature of one embodiment of the EPG system hardware is that display list 
hardware is capable of both video input and output on the same DMA hardware. The display 
processor is comprised of a video section and a FIFO section in an ASIC. The system has 
multiple clocks. The display memory has the capability to store 8 screen tiles in a horizontal 

20 plane. 

Described below in more'detail are the following improvements to an EPG: 

A. Improved viewer interaction capabilities with the EPG, including: 

1 . A Variety of Operating Modes. 

2. - Joy Stick and Track Ball Viewer Remote Interface. 

25 3 . Contextually Sensitive EPG On-Screen Control Mechanisms. 

4. Watch Scheduling. 

5. "All Channel" Guide Format, Channel Guide Format and 
"Next'VPrevious" Channel Guide. 

B. Improved viewer control of video recording of future-scheduled programming, 
30 including: 



1. 


Recording program displayed in PIP window. 


2. 


Recording "Regularly." 


3. 


Record Function rerun filter for "Regularly" recorded programs. 


4. 


Skip recording instruction. 


5. 


Automatic Record List Update. 


6. 


Recording on recordable Digital Video Discs. 


7. 


Speed Sensitive Tape Capacity. 


8. 


Record Instruction Conflict Resolution. 
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9. Recording from Theme Guides. 
C. Improved features to the EPG display and navigation, including: 



1. 


E-mail. 


0 


Mnltinlp Vif*wnhlf* u WinHn\i/c " 


3. 


Translucency on-screen effects. 


4. 


On-screen notifications. 


5. 


Theme ftavigation bar. 


6. 


Improved Scrolling through the EPG and Smooth Scrolling. 


7. 


"Jumping" in the EPG. 


8. 


Thematic color-coding of program schedule. 


9. 


Controllable number of days of programming. 



D. Parental control of the EPG display; 
1 5 E. Improved television program information access by the viewer, including: 

1 . Virtual Channel Ad Slots and Ad Window program advertisements. 

2. Additional detailed information for viewer access including link to the 
Internet. 

F. Improved opportunities for the commercial advertiser to reach the viewer, 
20 including: 

1 . Ad Window product-related video clips and infomercial recording. 

2. Ad Window program-related recording. 

3. Panel Ads. 

4. Virtual Channel Ad Slots. 
25 5. Placeholder Ads 

6. Full Screen ads. 

7. Automatic watch channel. 

8. Ad Features. 

G. Improved product information access by the viewer, including: 
30 1. Ad Window product detail. 

2. Ad Window product-related recording. 

3. Ad Window program-related recording. 

H. Creation of a viewer's profile, including: 

1 . Collecting viewer profile information. 
35 2. Analyzing and characterizing viewer profile information. 

I. Utilization of viewer profile information to customize various aspects of the EPG; 
and J. Utilization of viewer profile information to provide customized presentation 
of advertising to the viewer. ~~ 
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A. IMPROVED VIEWER INTERACTION CAPABILITIES WITH THE EPG 
1. A Variety of Operating Modes. 
5 Under the improved EPG system, there are multiple modes in which the viewer can 

operate the television. 

a. Television Mode. 

In the Television Mode, the viewer watches a full screen display of the television 
video programming. In one embodiment, in order to enter the EPG, the viewer presses the 

1 0 "Guide" key on the viewer's remote control device. In another embodiment, the EPG Grid 
Guide is the default mode. In the case where the EPG Grid Guide is the default mode, when 
the viewer turns the television on, the first thing that the viewer sees is the EPG in Grid Guide 
Mode as is described more fylly below. In one embodiment, at the viewer's option, as 
identified in the EPG set up procedure, the viewer can override the EPG Grid Guide default 

1 5 mode by selecting to automatically enter the Television Mode whenever the viewer first turns 
on the television. During setup procedures, the viewer can further instruct the EPG to 
automatically tune to the last-watched channel as identified when the viewer last turned off 
the television. The viewer can further instruct the EPG to automatically tune to the viewer's 
favorite channel, as is deduced from analyzing the viewer's profile information, described 

20 below. Alternatively, the viewer can instruct the EPG to automatically tune to a particular 
channel, e.g., a news channel such as CNN. 

b. EPG Grid Guide Mode. 

In the EPG Grid Guide Mode, the EPG displays the Grid Guide, or in the alternative, 
25 a Channel Guide. The viewer can request that the Grid Guide occupy the entire screen, be 
displayed over a portion of the screen as an overlay of the video television programming, or, 
in the preferred embodiment, occupy only a portion of the screen, typically 2/3 of the entire 
screen, while continuing to show the video television programming in the PIP Window of the 
screen. In the preferred embodiment, multiple Windows are displayed for the viewer, as are 
30 further described below, including at least: the EPG/Grid Guide Window, the PIP Window, 
and the Ad Window. 

Scrolling through the Guide is described below. The viewer can press the "Menu" 
key on the viewer's remote control device to go to the top of the Guide. 

The viewer can return to the full screen display of the video television programming 
35 in a number of ways. One way is to press the "Guide" key on the viewer's remote control 
device. Another way is to press the "Select"" key on the viewer's remote control device 
when the on-screen highlighting/cursor is highlighting a particular program listing on the 
Grid Guide for a program that is available for real-time viewing. Another way is to press the 
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"last channel" key on the viewer's remote control device to return to the program the viewer 
was watching before entering the Guide, or the last program on which the PIP window was 
5 locked (an option explained further below). 

L) Theme Guide Function. 
The EPG provides various Theme Guides, e.g., sports, movies, news, etc. Each 
Theme Guide presents program listings associated with a particular theme, e.g., all sports 
1 o programs. The Theme Guide display format only displays program listings, and consequently 
channels, for certain times of the day, with content appropriate for the selected theme. For 
instance, the Sports Theme Guide will display, typically in schedule order, only listings for 
channels that carry sports programs that are scheduled during a certain period of time, e.g., 
48 hours, 8 days, etc.. 

15 

2. ) Record Selection Function. 

In the Record Selection Function, also referred to as the Recording Function, the 
viewer instructs the EPG what programs to add to the Record List, which is the list of 
programs and related programming schedule information, for programs that the viewer want 
20 to have recorded. As is further described below, the viewer can identify the 
frequency/regularity with which the viewer wants to record each program listed in the Record 
List. 

The viewer can enter the Recording Function in a number of ways. The viewer can 
press the "Record" key, if there is one, on the viewer's remote control device. Alternatively, 
25 the viewer can "press" a "Record" action button on the EPG display. 

3. ) Watch Scheduling Function. 

In the Watch Scheduling Function, also referred to as the Watch Function, the viewer 
instructs the EPG what programs to add to the Watch List, which is the list of programs and 
30 related programming schedule information, for programs that the viewer want to watch. As 
is further described below, the viewer can identify the frequency/regularity with which the 
viewer wants to watch each program listed in the Watch List. 

The viewer can enter the Watch Function in a number of ways. The viewer can press 
the "Watch" key, if there is one, on the viewer's remote control device. Alternatively, the 
35 viewer can "press" a "Watch" action button on the EPG display. 

4. ) Data Do wnload Fun ction. 
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In some embodiments, data for the EPG schedule, and/or supplemental information 
relevant to the program listings, and/or advertising data, can be downloaded to the memory 

5 resident at the viewer's television system. In the preferred embodiment of the download data 
system, the viewer will ask the EPG to make certain types of information available; the EPG 
will use an index of where to find the information and will automatically connect to the 
appropriate data source and will download the information. Data for the EPG schedule, 
and/or supplemental information relevant to the program listings, and/or advertising data, can 

10 be downloaded from various sources. In one embodiment, data is downloaded from the 
Internet. In other embodiments of the download data system, the viewer is asked to tune to 
a particular channel at a particular time if the viewer is interested in accessing and 
downloading particular types of information. 

15 c Internet Mode. 

Not all embodiments require that data be downloaded to the EPG memory. In one 
embodiment, the EPG scheduling data, supplemental data and/or advertising data and the 
software to format, display, and navigate the EPG scheduling data, supplemental data and/or 
advertising data is accessed by the viewer's television system through a direct link between 

20 the viewer's television system and the Internet. 

In one embodiment of the above-described direct-link to the Internet, the viewer's 
television is connected to the Internet by telephone line via modem, by cable modem, by 
other two-way communication device, including wireless modem communication devices and 
by other conventional methods of communicating with the Internet. The initial connect web 

25 site address may be supplied, for instance, through information transmitted to the viewer's 
television over the vertical blanking interval (the "VBI"). The viewer may also be provided 
with a selection of multiple EPG Internet web sites. The viewer uses the remote control 
device to select one of the EPG Internet web sites 

The viewer's television system is programmed to emulate computer on-line access 

30 to the Internet. Once the connection between the viewer's television system and the Internet 
is made, the user has two-way communication with the on-line Internet service provider of 
the EPG related information. The user can then navigate through the EPG. Furthermore, in 
one embodiment, in which keyboard user interface is available, the user can enter chat rooms 
or other interactive services. 

35 

2. Joy Stick and Track Ball Viewer Remote Interface. 

The viewing user's video interface (UI) comprises the viewer's remote control device 
and the television monitor screen display. In one embodiment of the present invention, one 
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improvement in the UI offered by the present invention is the use of a joy stick as a substitute 

for the traditional remote control device configuration of a circle of four (4) arrow keys (up, 
5 down, left and right) with a select key in the center. The joy stick UI provides a user- friendly 

interface with the EPG. Use of the joy stick is intuitive. The viewer/ user does not have to 

look at the remote once the viewer's finger contacts the remote control joy stick. 

Accordingly, the viewer can control the UI while simultaneously watching, without 

interruption, the on-screen display. 
1 0 In another embodiment of the present invention, one improvement in the UI offered 

by the present invention is the use of a track ball as a substitute for the traditional remote 

control device configuration of a circle of four (4) arrow keys (up, down, left and right) with 

a select key in the center. 

In both the track ball and the joy stick embodiments, there is an on-screen "cursor." 
] 5 The viewer uses the track ball or joy stick remote control device to navigate the cursor to any 

location on the screen, much as a PC user navigates a cursor on a PC terminal window. 

3. Contcxtually Sensitive EPG On-Screen Control Mechanisms. 

"Keys," "buttons," menu "bars," and other such visual control mechanism devices are 

20 displayed on-screen for the control of the EPG. Typically, the visual control mechanism 
devices are sensitive to user-interaction. Typically, the viewer uses the UI remote control 
device to highlight a particular on-screen control device. Typically, the viewer then uses the 
UI remote control device to select the highlighted on screen control device. 

In one embodiment of the present invention, positionally constant on-screen control 

25 devices are contextually sensitive. That is, a particular button can be consistently displayed 
on every screen of the EPG in the same position and with the same color, from one screen to 
the next, from one mode to the next. With contextually sensitive control devices, even 
though the on screen control device has the same appearance and placement from one screen 
to the next and from one mode to the next, the button has a different function, and if selected, 

30 will provide a different result, depending upon the screen on which the button appears. In 
one embodiment, the function of the on-screen control device is textually described next to 
the control device, or, if the control device is sufficiently large, on the face of the control 
device. - 

For instance, in one embodiment, as illustrated in FIGS. 3, 4a and b, 5, and 6, the EPG 

35 displays two buttons at the top of each of the four screens pictured. In each of the four 
different screens, the top left button has a different function. (As referred to in this 
application, the directions "left" and "right" refer to the viewer's left and the viewer's right, 
respectively.) FIG. 3 depicts the EPG's on-screen Grid Guide in the programming scrolling 
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mode. In FIG.3, the viewer's-left button is described as "Watch." FIGS. 4a and 4b depict 
the EPG's on-screen Grid Guide in the channel-scrolling. In FIG. 4a and b, the viewer's-left 
5 button is a toggle button, alternately described as "Lock" and "Unlock." FIG. 5 depicts the 
EPG in the Watch Scheduling Function. In FIG. 5, the viewer's-left button is described as 
"Cancel." FIG. 6 depicts the Watch/Record Schedule screen of the EPG. In FIG. 6, the 
viewer's-left button is described as "Remove." 

10 4. Watch Scheduling . 

The EPG provides the viewer with the opportunity to select program titles, scheduled 
for delivery at future times, to watch. By selecting program titles, the viewer builds a "watch 
list." Watch list options and instructions provide functionality parallel to the EPG's Record 
Function. Instead of automatically recording the programs selected, the Watch Function 

15 automatically turns the television on, if it is not already on, and automatically tunes the 
television to the channel scheduled to deliver the designated program, if the television is not 
already tuned to that channel. This feature provides the viewer with the opportunity to watch 
a program of special interest at the scheduled time even if the viewer has forgotten about the 
scheduled delivery. This feature will also provide for parental selection of program viewing 

20 for children. 

The viewer can enter the Watch Scheduling Function in a number of ways. The 
viewer can enter the Watch Scheduling Function by selecting that Function from the EPG 
menu. The viewer can also enter the Watch Scheduling Function by highlighting an Ad 
Window displaying an advertisement for a future-scheduled program or a Virtual Channel 

25 Ad Slot displaying an advertisement for a future-scheduled program (both of which are 
described elsewhere in this application). 

The viewer can designate any program on the Watch List as a program that the viewer 
wants to watch regularly. In one embodiment, if the viewer enters the Watch Scheduling 
Function by highlighting an Ad Window or Virtual Channel Ad Slot, then if the viewer 

30 chooses to designate the program as a "regular" watch, the designation expires after a certain 
amount of time if the advertiser stops running the advertisement. The planned expiration is 
an incentive to the advertisers to renew their advertisements. 

5. "All Channel" Guide Format. Channel Guide Format nnd 
35 "NexrV"Prcvi(His» Channel Guide. 

The viewer can choose to view the Grid Guide in an "all channel" format which 
displays in some order every channel and the listings of programs already in progress or 
scheduled to begin at some time in the future. In the "all channel" format, the viewer scrolls 
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up and down the listings for each channel and from left to right and right to left to view the 
listings for a channel scheduled for different times during the day. Typically, the left-most 

5 portion of the guide begins with the earliest scheduled programs and continues to the right 
serially through the listings scheduled at later times during the day. 

As an alternative, the viewer can choose to view the programs scheduled for one 
channel at a time (a "Channel Guide"). In this format, the viewer scrolls up and down the 
listings for a single channel as scheduled for different times of the day. Typically, the "top" 

10 of the Channel Guide begins with the earliest scheduled program and continues serially 
through the listings scheduled at later times during the day. FIG. 9 is a graphic representation 
of a sample on screen EPG display depicting the Channel Guide function of the EPG. 

In the "Channel Guide" format, the viewer can select to view the Channel Guide for 
the "next" channel or for the "previous" channel. In one embodiment, the "Next" and 

1 5 "Previous" Channel Guide is an option on one of the EPG menus, action buttons or task bars. 
In another embodiment, the viewer's remote control device provides "Next" and "Previous" 
Channel Guide keys. In another embodiment, the viewer uses the up and down arrow keys 
to navigate to the next or previous Channel Guides. 

20 B. IMPROVED VIEWER CONTROL OF VIDEO RECORDING OF FUTURE-SCHEDULED 
PROGRAMMING 

1. fiewnUng program display^ \x\ HP wjndo>v t 

As explained in more detail below, the EPG provides for multiple "windows." One 
25 window displays the currently tuned program. When the viewer enters the EPG from the 
television mode, the PIP window is "highlighted." In one embodiment, highlighting of the 
PIP window is accomplished by a color change of the border around the PIP window. While 
the PIP window is highlighted, the viewer can instruct the EPG to record the displayed 
program. In one embodiment, the viewer records the displayed program in the highlighted 
30 PIP window by pressing the record button on the viewer's remote control device. 

2. Recording "Regularly." 

One embodiment of the present invention provides the viewer with the option of 
recording a particular program "regularly." The "regularly" option can be selected when the 
35 viewer highlights a particular program title on the EPG Grid Guide. Viewer selection of the 
"regularly" option instructs the VCR control system to record the particular title on the 
selected channel at the selected time slot any day of the week that the program is telecast. If 
a telecast of the selected title is preempted by another program, the new program is not 
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recorded. The change in the telecast schedule is determined by comparing the title of the 
selected program to the title of the program actually telecast. In one embodiment of the 
invention, it is assumed that the title of the program actually telecast is carried in the vertical 
blanking interval of the television signal. When the viewer has instructed the EPG to 
"regularly" record a particular program, if the selected program is preempted by another 
program, the preempting program is not recorded and the EPG displays a message notifying 
the viewer that the selected program was preempted and was not recorded. 

3. Record Function rerun filter for "Regularly" recorded programs. 

The EPG is capable of detecting reruns. The identification of the program as a rerun 
may be carried in the VBI of the program broadcast. In another embodiment, the rerun 
identification information is available in the program detail. In one embodiment of the 
Record Function, when the viewer selects the "Regularly" record option, the viewer is also 
given the option of filtering reruns. If the viewer selects the rerun filter option, then every 
time the program is regularly scheduled, the EPG determines whether or not the program 
episode to be delivered is identified as a rerun. If the episode is a rerun, and if the viewer has 
selected the rerun filter option for that program title, then the EPG will not record the episode. 

4. Skip recording instruction. 

In the EPG's Record Function, the viewer selects a program title for recording. Once 
a program title has been selected, the viewer is asked to select a record-scheduling option. 
The viewer can select Once, Daily, Weekly, or Regularly as a record-scheduling option. If 
the viewer has selected a record-scheduling option of Daily, Weekly, or Regularly, one 
embodiment allows the viewer to skip recording of the program one time. The One-time skip 
instruction would result in the EPG not recording the program title, even though the record 
instruction for that program title remained in the record list. 

In the EPG's Record Function, the viewer can turn select the skip instruction for all 
programs on the Record List, or for selected programs on the Record List. This feature might 
be used when the viewer goes on vacation. The programs remain on the Record List. At the 
viewer's option, the viewer can turn off the skip instruction for all programs on the Record 
List, or for selected programs on the Record List. 

5. Automatic Record List Update. 

In the EPG's Record Function, the EPG will detect changes in program scheduling 
as compared to record instructions for particular program titles designated for recording. In 
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one embodiment, when the EPG detects program scheduling changes, the Record List is 
automatically updated with the schedule change information. For instance, if a sports event 
5 runs longer than the originally scheduled time, a packet of scheduling update information can 
be transmitted over the VBI that updates the time of the programs scheduled to be telecast 
after the sports event. The EPG detects the VBI scheduling updates and updates the 
recording list to permit the recording of any programs following the sports program to be 
recorded as appropriate. 

10 

6. Recording on recordable Digital Video Discs, 

The viewer can instruct the EPG to record programs on recordable Digital Video 
Discs (DVD's). Because of the extended storage capacity of DVD's, the viewer can instruct 
the EPG to record and index ah extended period of programming. For instance, the viewer 

15 can instruct the EPG to record and index, e.g., 4 hours of CNN news broadcasts certain 
number. When the viewer is ready to view the DVD recording, the EPG displays the DVD 
index on screen. The viewer can then select to view either the entire DVD, or only those 
portions of the recording in which the viewer is interested. 

In one embodiment, program-level indexing of recorded programs is created. In 

20 another embodiment, intra-program indexing is created by using information transmitted in 
the VBI of the video transmitted. In this embodiment, a recording of CNN would likely show 
indexing breakdowns that include themes, such as "International News " "National News, " 
"Sports " "Entertainment " "Business & Finance ," and "Weather." 

In yet another embodiment, intra-program indexing is created using some constant 

25 time interval. The index shows a start and end time interval, and audio content excerpts. 

In still another embodiment, indexing software analyzes the audio content of the 
program recorded ("Content Analysis Program"). This is typically in addition to using all 
indexing breakdown information transmitted in the VBI of the program. The Content 
Analysis Program uses speech and voice recognition technology to analyze, among other 

30 things, such variables as: changes in announcers, changes in tone, changes in speed, topical 
words, geographic locations, substantive words. The Content Analysis Program then creates 
a topical index in addition to the theme index described above. 

7. flpecd Sensitive Tape Capacity. 

35 The EPG's Record Function provides a Record List that identifies the titles of 

programs that the viewer has selected to be recorded. The speed sensitive tape capacity 
feature uses color coding to identify in one color the titles that would fit on one tape at a fast 
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tape speed and to separately identify, with another color, the titles that would fit on one tape 
at slow tape speed. 

5 

- 8. Record Instruction Conflict Resolution. 

The EPG's Record Function recognizes conflicts in viewer record instructions. In one 
embodiment, the EPG's Record Function prompts the viewer to resolve the conflict. For 
instance, in the Record Function, the EPG would accept viewer instructions to record a 

10 particular program. The EPG compares the newly received record instruction to as-yet 
incompletely executed, or as yet unexecuted, record instructions in the Record List. If the 
EPG detects an overlap in date, time and duration between the newly received instruction on 
the one hand and one or more of the remaining record instructions in the Record List, the 
EPG formats a message to the viewer describing the conflict. The message describes to the 

1 5 user the newly received instruction to record a particular program and the conflicting record 
instructions in the Record List. In Record Function, the EPG will prevent entry of conflicting 
instructions into the Record List. The EPG will require that the viewer revise the record 
instructions to eliminate the conflict. In one embodiment, if the EPG detects that one 
recording instruction pertains to a "one occurrence" program that conflicts in date, time and 

20 duration with a recording instruction to record a "regularly recorded" program, the EPG 
would format an on screen message that would suggest to the viewer that the viewer select 
the "one occurrence" program to be recorded. In another embodiment, the EPG automatically 
"decides" to override the "regularly record" instruction and will record the "one occurrence" 
program with no further intervention by the viewer. 

25 One way to resolve a recording instruction conflict is to chose an alternative 

occurrence of the conflicting . program for recording. In one embodiment of the EPG, the 
viewer can highlight a particular program in the EPG and request a list of all occurrences of 
that program for the week. The viewer can then instruct the EPG to record an alternative 
occurrence of the program. In an alternative embodiment, the viewer can view an 

30 alphabetical list of all programs for the week. The viewer can mark a program for viewing 
or recording from the alphabetical list. 

9. Recording From Theme Guides. 

The EPG provides various Theme Guides, e.g., sports, movies, news, etc. When the 
35 viewer selects a particular Theme Guide, e.g., the Sports Theme Guide, the viewer can 
instruct the EPG to record an event while in the Theme Guide without having to exit the 
Theme Guide and go to the program Grid Guide. For instance, in the Sports Theme Guide, 
the viewer instructs the EPG to add a sports event to the Record List by clicking on the box 
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score for a particular sports event and/or on the sports program listing in the Sports Theme 
Guide. 

5 

C IMPROVED FEATURES TO THEEPG DISPLAY AND NAVIGATION 

1. E-mail . 

In the preferred embodiment, the EPG interfaces with the Internet/World Wide Web. 
10 In the preferred embodiment, the viewer can access the Internet to send and receive e-mail. 

In another embodiment, the television terminal is separately addressable, and the head 
end controls e-mail traffic between viewers on its network. To facilitate two-way 
transmission a 900 or toll free number is used as a back link. E-mail can then be sent to the 
appropriate viewer through the VBI to the viewer's separately addressable television. 

15 

2. Multiple Vie wable "Windows." 

The EPG UI screen provides for multiple viewable "windows." One window presents 
the EPG Grid Guide. Another window presents the picture-in-picture (PIP) window on which 
the currently tuned program is displayed. Another window displays advertising information 

20 (the "Ad Window"). Advertising may be in the form of graphics and textual information. 
Alternatively, advertising may be in the form of video display. In one embodiment, the Ad 
Windows are interactive. 

As the viewer enters" the EPG from the television mode, the PIP window is 
highlighted. The viewer can lock the PIP window. Locking the PIP window allows the 

25 viewer to continue to watch the television program being displayed in the PIP window while 
the viewer scrolls through the EPG program Grid Guide. Unlocking the PIP window causes 
the video for the program title highlighted in the Grid Guide to be displayed in the PIP 
window. 

As described further below, the viewer can also highlight the Ad Window. Doing so 
30 will cause additional text describing the product to be displayed in the detail box are of the 
EPG Grid Guide. 

If the Ad Window displays information about a particular product, pressing a record 
button will instruct the EPG to record an infomercial, to the extent that one is scheduled for 
a future time. Alternatively, the Ad Window can display information about a future- 
35 scheduled television program or about a series of programs to be telecast over a period of 
time. In that case, pressing a record button will instruct the EPG to record the future- 
scheduled program. Alternatively, the viewer can designate the program for the Watch List. 

-17- 



WO 99/04561 



PCI7US98/15093 



1 

In one embodiment, the viewer navigates from the Grid Guide to the PIP Window by 
pressing the left arrow key until the cursor/highlighting reaches the PIP Window. From the 

5 PIP Window, the viewer uses the right arrow key to move back to the Grid Guide. In one 
embodiment, moving from the PIP Window to the Grid Guide causes the cursor to scroll to 
the very top of the Grid Guide lineup. From the top of the Grid Guide lineup, pressing the 
up arrow key moves the cursor to the navigation bar. The EPG provides several possible 
destinations on the navigation bar, e.g., info center, sports, news, set up, help, etc. 

10 From the PIP Window, pressing the down arrow key moves the cursor to the Ad 

Window. 

The viewer can set a default, or allow the system default, to highlight a particular 
navigation bar destination when the viewer initially enters the Grid Guide. 

]5 3. Translucency on-screen effects. 

In one embodiment, the EPG creates special translucency visual effects. To create 
the translucency effect, the system alternates the display format pixel by pixel-one pixel is 
the color of the overlay and the next pixel is transparent. 

20 4. On-screen notifications. 

The EPG formats on-screen notifications to the viewer and displays the notification 
to the viewer. On-screen notifications can be used to alert the viewer to any number of 
possible items of information. For instance, the EPG can notify the viewer that the EPG will 
begin recording a particular program within a certain amount of time, e.g., 2 minutes. The 

25 record notification could further ask the viewer whether to switch the cable box to record the 
program. If the viewer indicated that the viewer did not want the EPG to switch to the cable 
box to record the program, then the EPG would delete the program from the record list. 
Another example would be to notify the viewer that a program that may be of interest (e.g., 
as determined from analyzing the Viewer's Profile) will be broadcast on another channel 

30 within a certain amount of time, e.g., 2 minutes. The EPG could then ask if the viewer wants 
to view the program on the other channel. If the viewer indicates that the viewer wants to 
watch the program on the other channel, then the EPG will automatically tune to the other 
channel at the appropriate time. Alternatively, the EPG could ask the viewer is the viewer 
wants to record the program on the other channel and could then record that program at the 

35 appropriate time if the viewer answers affirmatively. 

If the television is in television mode, the notification will be displayed on-screen. 
The notification can be displayed in a number of ways, including: I.) a complete screen 
overlay; 2.) a partial screen overlay; 3.) The real time program video is automatically changed 
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to a PIP format, and the notification is displayed outside of the PIP window; 4.) The real time 
program video is automatically changed to a PIP format, and the notification is displayed 

5 inside of the PIP window; 5.) as a "watermark" somewhere on-screen; 6.) an on-screen icon 
is displayed which can be "pressed" by the viewer using the navigation keys on the viewer's 
remote control device, and which, if pressed, displays the notification in one of the above 
formats; 7.) the program video is compressed slightly to fit in some percentage, e.g., 90%, 
of the top of the screen, and the notification is displayed as a horizontally-rolling message at 

10 the bottom of the screen; 8.) the program video is compressed slightly to fit in some 
percentage, e.g., 90%, of the bottom of the screen,, and the notification is displayed as a 
horizontally-rolling message at the top of the screen. 

If the television is in some mode other than the television mode, the EPG can notify 
the viewer through some modification of one of the above-described formats. For instance, 

15 if the television is in the Grid Guide mode in a PIP format, then the EPG could use any of 
format numbers 1 .), 2.), 5.), 6.), 7.), 8.) or, the EPG could notify the viewer by displaying the 
notification in the Ad Window, a virtual ad channel slot, in the detail information window, 
or in a horizontally-rolling message at the top or bottom of the screen. 

20 5. Theme navigation bar. 

The theme display is above the top of the Grid Guide. In one embodiment, the Grid 
Guide display provides for a "page up" on-screen button. In one embodiment, the Grid Guide 
display also provides for a "menu" button. The viewer can scroll to the top of the Grid Guide 
by successively "pressing" the page up on-screen button, or by "pressing" the menu button, 

25 _ f . : ^ r ^^ ,: V 

6. Improved Scrolling through the EPG and Smooth Scrolling. -^'^ 

In the top level screen of the EPG in Grid Guide mode, the viewer user can jump ^k^'^ < i 

directly to a future day of programming schedule information. \*l j, V 

In one embodiment, the Grid Guide display provides for a "page up" on-screen button. ^ ^ , , 

30 Program schedule information for a plurality of channels is displayed on a screen of , ■ ;i 

the EPG in Grid Guide mode. Titles are shortened for display in the Grid Guide to conserve [ 

space. The entire title is available to the system and is displayed in the detailed description * 

area of the Grid Guide when the viewer highlights a tile in the Grid Guide for the * 

corresponding program listing. But the EPG shortens the titles, according to a set of rules for 

35 shortening the titles, so that the titles fit in the scheduling tiles of the Grid Guide. 

The viewer can scroll up or down through the program listings. While scrolling, the 

titles are not drawn until the scrolling stops. Such a delay in drawing titles speeds up the 

processing and makes the screen appearance less confusing. While scrolling, the cursor will 
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not highlight the top or the bottom tile on the screen unless the channel is the top or bottom 
of the lineup. The absence of highlighting signals to the viewer that more channels remain 

5 in the scrolled direction. 

A farther improvement to the EPG User Interface ("UI") is the development of 
"Smooth Scrolling." When the cursor reaches the second tile from the bottom, and a new tile 
appears on the bottom, the entire tile and its contents, e.g., a program title, grow gradually in 
height until the newly appearing tile reaches full tile height. At the same time, the tile that 

1 0 is disappearing from the top of the screen, and the contents of that top tile, shrink in height 
until the tile is gone. This provides a smooth transition in the overall screen display but is 
not actually perceptible because it is changing at 1/60 of a sec. 

Smooth Scrolling is less disorienting to the viewer than a page by page screen change, 
which is the scrolling technique used in existing on screen guides. The entire bit map does 

1 5 not need to be redrawn as you scroll up one tile-only the top tile is shrunk or compressed in 
the vertical dimension. 

In one embodiment, while slowly scrolling, the new title appearing on the screen is 
not redrawn until the scrolling stops. While rapidly scrolling multiple tiles, the processor 
stops redrawing the title on any of the tiles during the scroll; the processor waits until the j 

20 scroll stops or slows down to redraw the titles. This permits faster scrolling because the titles \ 
do not have to be retrieved until the screen reaches the desired point. Redrawing the data is / 
very processor intensive. A special interaction between the firmware and the hardware is/ 
required to minimize redrawing the bit map and retrieving data from memory. This applies 
to both vertical and horizontal scrolling. The user can remain oriented because the channel 

25 identifiers and schedule times remain displayed. 

A V 

7. "Jumping" in the EPG. ~~ 

The viewer can "jump" to the desired action or location in the EPG in a number of 
ways. In the Grid Guide, the viewer can jump to the channel slot for a particular channel by 
30 entering the digits of the channel identification number on the key pad of the viewer's remote 
control device. The EPG interprets the number and calculates the proper position for the EPG 
cursor. The EPG then displays the cursor at the appropriate channel slot on-screen. 

In one embodiment, the viewer's favorite and/or most watched channels are displayed 
as buttons on a favorite channel selection bar somewhere on the EPG display of the Grid 
35 Guide. The viewer can jump to one of the viewer's favorite channels by "pressing" the 
appropriate channel button. 

In another embodiment, the viewer's remote control device displays letters associated 
with the numbers on the key pad. The viewer can use a special "Alt" key to allow the viewer 
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to press the keys as if alphabetic and/or alphanumeric. In this way, the viewer can enter a 
channel identifier, such as "CNN". 

5 In yet another embodiment, the viewer can request a pull down menu of favorite 

channel identifiers and can select a channel from the pull down menu. 

In yet another embodiment, the viewer can set "bookmarks" in the EPG by using a 
"bookmark" key on the viewer's remote control device, or alternatively, a "bookmark" button 
on the EPG display. The viewer can press the "bookmark" key when the user wants to mark 

10 a current location for later return. The viewer can then scroll, jump, or otherwise navigate 
away to some other location in the EPG. When the viewer wants to return to the book 
marked location, the viewer can press the "lastmark" key (on either the viewer's remote 
control device, or alternatively on the EPG display). The EPG can record a plurality of book 
marked locations. In one embodiment, the EPG can remember book marked locations after 

15 the viewer turns off the television and then turns on the television multiple times. 

8. Thematic color-coding of program schedule. 

The EPG categorizes programs according to a plurality of themes. In one 
embodiment, the EPG color codes the presentation of the program in the Grid Guide 
20 according to the theme categorization assigned to the program. 

9. Controllable number of days of programming. 

Typically, the EPG will carry only 2 days of program listings. At the viewer's 
selection, the EPG can carry only a single day of program listings. The single day option 
25 provides a smaller range of program listings but increases response time. Alternatively, the 
viewer can select to carry any number of days of program listings, up to the number of days 
that is provided for by the particular installation, which is set by the corresponding amount 
of memory storage available. 

30 D. PARENTAL CONTROL OF THE EPG OTSPLA V 

The Parent viewer initially enters the Parental Control Function during initial EPG 
setup procedures. In the EPG setup procedure, the Parent identifies all viewers of the 
television, and assigns individual viewer Identifiers. The Parent viewer also establishes a 
password for said Parent viewer. U.S. Provisional Patent Application Serial No. 60/085.401 
35 ("V-CHIP Plus+: In-Guide User Interface Apparatus and Method for Programmable Blocking 
of Television and other viewable programming such as for Parental Control of a Television 
Receiver") describes Parental Control setup procedures for the identification of individual 
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viewers and initialization of password protection, the disclosure of which is incorporated by 
reference here as if fully stated herein. 

5 In the Parental Control Function, the Parent selects the channels and programs that 

can be visible in the Grid Guide for a particular viewer and selects channels and/or programs 
that are to be blocked from viewing. Child viewers, as identified during setup procedure, will 
view a simplified Grid Guide and will be blocked from viewing the programs so marked by 
the Parent. In one embodiment, individual viewers are identified by viewer ID and password. 

1 0 In another embodiment, individual viewers have different remote control devices, the use of 
which is also password protected. 

E. IMPROVED TELEVISION PROGRAM INFORMATION ACCESS BV THE VIEWER 

1. Virtual Channel Ad Slots and Ad Window program advertisements. 
15 As described below, the EPG provides the viewer with multiple opportunities to 

obtain detailed information about television programs. As is further described below, the 
EPG provides the viewer the opportunity to select Virtual Channel Ad Slots or Ad Window 
displays that advertise future-scheduled television programs and get additional information 
in the way of text or video clips. 

20 

2. Additional detailed information for viewer access including link to the 
Internet. 

The EPG displays detailed information relevant to program listings in the detailed 
information area of the Grid Guide. The detailed information can include, among other 

25 things, a detailed textual description of the program, information about the actors and 
actresses, information about the production of the program, product related information, 
identification of relevant Internet web sites and online Internet chat rooms. The EPG 
provides the viewer with the ability to request detailed information from such guides/data 
services in a number of ways, including when the viewer highlights: a particular program in 

30 the Grid Guide, the Ad Window, or a Virtual Channel Ad Slot. In one embodiment, the 
viewer's remote control device has a power "Information" key. When the viewer has 
navigated the on screen highlighting/cursor to a particular tile or window on the EPG on 
screen display, the viewer can press the remote control device "Information" key to request 
the additional information 

35 In one embodiment, when the viewer highlights a particular program in the Grid 

Guide, the Ad Window, or a Virtual Channel Ad Slot, or other requests access to detailed 
program-related information, the EPG connects the viewer with an external database of 
information, such as with a particular web site on the Internet. The viewer can instruct the 
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EPG to connect the user with detailed specialized information guides/data services, such as 
sports, news, or other guides/data services. In one embodiment, the linking to the external 

5 data source is accomplished by storing a web site address with the Ad Window or Virtual 
Channel Ad Slot advertisement in the RAM of the user terminal. 

A sports program listed in the Grid Guide provides an illuminating example of how 
the viewer interacts with such a detailed specialized information guide/data service. When 
the viewer highlights a football game listed in the Grid Guide, the normal detail concerning 

10 the program is displayed in the detailed information are of the Grid Guide. Furthermore, 
multiple icons related to the highlighted program can be displayed in the Grid Guide. One 
icon alerts the user that the game is already underway. Another icon indicates the availability 
of specialized guide information. The viewer can select the program from the Grid Guide foj^ 
viewing and/or recording. In addition, the viewer can select the specialized guide icon. In 

1 5 the case of a sports program, selecting the specialized guide icon would display, for instance, 
a scoreboard for the game if the game were already in progress in the detailed information 
area of the Grid Guide. If the game were scheduled for a future time, then selecting the 
specialized guide icon would display, for instance, information about the players, the teams, 
and perhaps, the odds about the game. 

20 Another icon, displayed for instance in the display of the sports guide scoreboard, 

provides the viewer with the option of connecting to the Internet, e.g., to a particular web site 
that provides additional information about the game, possibly, including online chat about 
the game. In one embodiment, the EPG switches to full screen to display of the Internet web 
site. In another embodiment, the EPG displays the Internet web site in the area of the screen 

25 previously occupied by the Grid Guide and/or the Grid Guide and the Ad Window, while 
continuing to display the real time video display of the currently tuned television program in 
the PIP window. Alternatively, the EPG can display the Internet web site in the PIP window 
and display the currently tuned television program in the area of the screen previously 
occupied by the Grid Guide and/or the Grid Guide and the Ad Window. The Internet web 

30 site to which the EPG initially connects (the "contact web site") may be a specialized 
directory, using pre-determined hyperlinks to the viewer to other cites of interest. The 
contact web site may additionally, or in the alternative, offer search capabilities to the viewer 
to locate information of interest. 

Once the viewer is connected with a specialized information guide/data service, the 

35 viewer can use the guide/data service to direct the viewer to particular information contained 
in the EPG Grid Guide. For instance, a viewer selects a news program to watch. While 
watching the news program, the news broadcaster describes an event involving astronauts. 
The viewer selects the news guide/data service icon and connects to a web site on the Internet 
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describing, among other things, additional information about the particular event involving 
the astronauts. The viewer uses the search engine offered by the contact web site to locate 
5 additional information about the same astronauts. At the subsequent web sites, a Discovery 
Channel program is mentioned concerning some of the same astronauts. The viewer instructs 
the EPG to locate any occurrence of the referenced program and to schedule that program to 
be recorded. In one embodiment, a PLUS CODE-like address is used to link to, or record, 
the scheduled program. 

1 o The viewer can search an index, available on the Internet and created by a news data 

service, of recorded television news programs and reports. The viewer can search the index. 
If the viewer selects one of the indexed reports, a video clip of the indexed report will be 
shown in the area on the screen occupied by the Internet web site display, or any alternate 
area or portion of the on-screen display. The viewer can instruct the EPG to record the video 

15 clip. 

The EPG is capable of integrating additional information provided by the special data 
services into the EPG display. For instance, in the case of a sports data service, the EPG can 
format the program listing display and/or the sports scores for a game with special color 
coding depending upon the stage of the game. For instance, if the game is in progress, the 

20 EPG will format the program listing and/or the sports scores for that game with one color, 
e.g., green; if the game is completed, the program listing and/or the final scores can be in a 
different color, e.g., blue. If the game is in progress, the viewer can highlight and select the 
box score to move from the box score to the game shown on the television. In one 
embodiment, the selected television sports program appears in the PIP Window or the Ad 

25 Window, allowing the viewer to read the sports program-related story in the sports guide 
while watching the corresponding television sports program. 

The EPG is further capable of linking between news items in a special news guide and 
related television programs. The viewer can link to a news program to watch or record that 
program by highlighting and selecting a news item in a news guide. In one embodiment, the 

30 selected television news program appears in the PIP Window or the Ad Window, allowing 
the viewer to read the story in the news guide while watching a tv news program that reports 
on the event. 

In one embodiment, the VBI for selected channels are dedicated to the delivery of a 
special data service. For instance, the ESPN VBI would carry the sports data service only. 
35 In one embodiment, as an incentive to carry this data, the data service would display the 
ESPN TV program in the PIP window. Since the tuner must be set to ESPN to capture the 
data, the television signal is available for display in the PIP. 
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F. IMPROVED OPPORTUNITIES FOR THE COMMERCIAL ADVERTISER TO REACH THE 
VIEWER 

1. /Vd Window product-related video clips and infomercial recording 
The EPG provides producers of infomercials with extended capabilities to reach the 

viewers through the Ad Window. Because of the cost of buying advertising time, a growing 
number of product manufacturers and marketers produce infomercials about their products 
and then buy relatively inexpensive air time for their infomercials according to off-prime- 
time schedules, often on non-prime channels. The EPG provides the producers of 
infomercials with the opportunity to provide the viewer with the opportunity to record an 
infomercial that is broadcast at a time, or on a channel, that would be inconvenient for the 
viewer to watch real-time. 

If the Ad Window displays information about a particular product, pressing a record 
button will instruct the EPG* to record an infomercial or advertisement, to the extent that one 
is scheduled for a future time. Alternatively, the viewer can designate the infomercial or 
advertisement for the Watch List. Alternatively, the EPG provides the producers of 
infomercials with the opportunity to provide the viewer with the opportunity to view a video 
clip about the product being advertised. 

In one embodiment, the video clip associated with the product and/or program 
displayed in the Ad Window is shown when the viewer highlights the Ad Window. 
Depending upon the embodiment and/or viewer option selections, the video clip is shown in 
the PIP window, in the Ad Window, or full screen. At the conclusion of the video clip, the 
EPG typically returns to the mode in which the viewer was operating immediately before 
selecting the option that triggered the display of the video clip. 

2. Ad Window program-related recording 

The EPG provides distributers of television programming with additional 
opportunities to reach the viewer. The Ad Window can display information about a future- 
scheduled television program. If the viewer is interested in recording the program, the viewer 
can take a number of alternative actions. For instance, in one embodiment, the viewer can 
instruct the EPG to record the future-scheduled program. In one embodiment, the viewer 
presses record button on the remote control device to instruct the EPG to record the future- 
scheduled program. Alternatively, the viewer can instruct the EPG to add program to the 
Watch List. Alternatively, the viewer can instruct the EPG to display a video clip about the 
program. Yet further, the viewer can instruct the EPG to connect the user with detailed 
specialized information guides/data services, such as sports, news, or other guides/data 
services. The EPG provides the viewer with the ability to request detailed information from 
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such guides/data services in a number of ways, including when the viewer highlights: a 
particular program in the Grid Guide, the Ad Window, or a Virtual Channel Ad Slot. In one 
embodiment, the EPG displays relevant detailed information in the detailed information area 
of the Grid Guide. In another embodiment, the EPG connects the viewer with an external 
database of information, such as with a particular web site on the Internet. 
3. Panel ads. 

In one embodiment, Panel ads occupy a fixed area in the Guide and are generally 
filled with paid advertisements. Located directly below the PIP in an Ad Window, space i& 
available in the Guide for two Panel ads. Each Panel ad occupies approximately l/9th of the 
total screen area. The usable area of a Panel ad is 132 pixels high x 160 pixels wide, with 2 
pixel wide black borders all around and 2 pixels of gray on the left and right sides and 
between the two ad spaces. When a given ad space is not sold, the space will be filled with 
a Placeholder ad, stored in ROM, and inserted in the available space, or with a bonus ad. 

An advertiser may purchase both l/9th screen areas, thus creating a single ad with a 
usable space of 270 pixels high by 160 pixels wide, with 2 pixel wide black borders all 
around and 2 pixels wide of gray on the left and right sides. 

In one embodiment, all Guide screens are made up of "hard pages." A hard page is 
defined as an area comprising 9 channel slots. Each time a user scrolls below the 9*x channel 
slot, a new "hard page" appears. Scrolling back up will bring the previous hard page back 
into view. Each hard page may have different Panel ads associated with it. 

In one embodiment, Hard pages are defined differently in the Sort screens. Each sort 
category (e.g. Movies, Sports, Children's) will be considered one hard page regardless of the 
number of items in the list vertically. As the user moves horizontally from one category to 
the next, the Panel ads will change. 

The number of hard pages available depends on the size of the user's lineup and the 
number of channels turned on or off. In the event that there are not enough channels to 
support the number of hard pages required for the number of Panel ads sold, not all Panel ads 
will be displayed. For example, assume that 4 pairs of Panel ads and 4 Channel ads are 
saved in memory. Additionally, assume a particular user has 20 active channels in his 
channel lineup. Then the ads would be displayed as follows: 

Panel ad Pair 1 with channels 1-8 and the first Channel ad 

Panel ad Pair 2 with channels 9-16 and the second Channel ad 

Panel ad Pair 3 with channels 17-20 and the third and fourtli Channel ads 
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If the user turned on more channels requiring the addition of a fourth hard page, then 
the fourth Panel ad Pair would become visible. 

5 In one embodiment, the user can highlight these ads, resulting in the automatic display 

of an expanded information box. This expanded information box covers the entire right-hand 
2/3rds of the grid. The user closes the expanded information box by moving the highlight off 
the Panel ad or by pressing the information button after the last related information box 
screen has been presented. FIGS. 10a and 10b are graphic representations of sample on 

10 screen EPG displays depicting one embodiment of the feature of presenting additional 
information concerning the subject matter of a highlighted Panel Ad Window. 

In one embodiment, Panel ads are surrounded by flat black borders. When a panel ad 
is highlighted, the border turns yellow. When a program is set to record the border turns red 
(dark red when the Panel ad is not highlighted, light/bright red when highlighted). When a 

1 5 program is scheduled to watch, the border turns orange (dark orange when the Panel ad is not 
highlighted, light/bright orange when highlighted). 

In one embodiment, there can be multiple information "screens" displayed 
sequentially in the expanded information box. Pressing the Info, button while an ad is 
highlighted accesses these additional screens. There is no finite limit to the number of 

20 additional screens; memory limitations and selling requirements will limit this number. 

In one embodiment, if a Panel ad is highlighted, has show information associated with 
it, and the advertised show is currently on, the user may tune directly to the related program 
by pressing the Left Action button (the Blue button which is labeled "Watch") or by pressing 
the Enter/Select button on the remote. Pressing the Watch button also places the show in the 

25 Record/Watch Schedule for the duration of the show to allow the user to set the frequency 
to daily or weekly. If the show is not currently on, pressing the Left Action button places the 
show in the Record/Watch Schedule or; pressing the Enter/Select button tunes to the channel 
related to the show in the ad. Shows added to the Record/Watch Schedule may be set to be 
viewed: once, daily, or weekly. The Watch feature and related Action button labels operate 

30 in the same way as if scheduling a show to watch from the Grid. 

In one embodiment, if a Panel ad has show information associated with it, the show 
may be recorded by highlighting the ad and pressing the Right Action button (the Green 
button, labeled "Record"). If the show is on now, recording begins immediately and the show 
is placed in the Record/Watch Schedule for the duration of the show to allow the user to set 

35 the frequency to daily or weekly. If the show is on in the future, that show is added to the 
Record/Watch Schedule for auto-recording. Shows added to the Record/Watch Schedule may 
be set to be recorded: once, daily, or weekly. The Record feature and related Action button 
labels operate in the same way as if scheduling a show to record from the Grid. 
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In one embodiment, Panel ads can be dynamic. There are two areas which may be 
dynamic: 1.) the Panel ad space; and/or 2.) the Information box. 

5 The Panel ad area may change over time, e.g., every x seconds rotating through a 

plurality of different graphical or textual ad executions in the Panel ad space. When a Panel 
ad is highlighted, the ad rotation stops on the currently displayed ad visual. The dynamic 
rotation does not restart until the Panel ad is de-highlighted. 

The information box text associated with the Panel ad may change over time, e.g., 

1 o every y seconds, rotating through a plurality of different screens of text. The screen rotation 
stops if the user presses the Info. Button, displaying the first page of info. text. This option 
is available for advertisers to rotate different headlines in the information box. The user may 
view subsequent pages by pressing the Info, button again. The screen rotation does not restart 
until after the Panel ad is de-highlighted. 

15 

4. Virtual Channel Ad Slots. 

The EPG provides producers of infomercials with extended capabilities to reach the 
viewers through Virtual Channel Ad Slots, also referred to as Channel ads. Virtual Channel 
Ad Slots appear as rows of the Grid Guide and typically show the titles of the programs that 

20 are scheduled for a particular channel. The EPG Grid Guide's Virtual Channel Ad Slots 
provide advertisement to be displayed as a row in the Grid Guides schedule of programs. The 
Virtual Channel Ad Slots may be used to provide multiple exposures of a particular program 
in the guide. The Virtual Channel Ad Slots act like a channel entry in the Grid Guide in that 
the viewer can record, watch, schedule for watching, and/or get information about the 

25 advertised program in the information detail box of the Grid Guide. 

In FIG. 1 of the drawing, tile 52 shows an example of a Virtual Channel Ad Slot for 
an ad for a television program-it is a program listing that is out of place channel-wise and 
time-wise in the Grid Guide 22. That is, it does not appear in the usual channel position or 
time position in the guide, but the tile is otherwise like the other program listing tiles of grid 

30 guide 22 (including height), except that it occupies the entire width of the tile irrespective of 
the duration of the program. A tile for a normal program listing scrolls off the screen as the 
up and down arrow keys are pressed. In contrast, in one embodiment, a Virtual Channel Ad 
Slot, such as shown in tile 52, remains on the screen at all times as the up and down arrow 
keys are pressed, so the ad remains in view at all times. 

35 Channel ads do not occupy a fixed area. Channel ads are essentially inserted between 

channels in the grid. If there are no Channel ads sold, the grid will simply be a continuous 
list of channels/show tiles with no gaps. As these channel ads take up a channel slot in the 
grid, it is desirable to limit how many are likely to appear on any one screen to ensure the 
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Guide is a useful source of TV programming information. Typically, there will be 
approximately 1 Channel ad per hard page. 
5 Channel ads are typically the height of a channel slot, the width of the grid and are 

intermingled with the channel listings. The usable area for a Channel ad is typically 24 pixels 
high x 344 pixels wide, with 2 pixel wide bevels all around. 

There are several types of Channel ads, including: Relative, Parent, and Fixed position 
Channel ads. 

10 Relative Channel Ads appear in a position relative to the top of the grid and are 

spaced every n channel slots, where n is some number. These ads appear and disappear as 
the user pages through the Guide's hard pages. It is anticipated that n will usually (but not 
necessarily always) equal 9 since this is the number of channels in the PIP version grid. This 
would provide for one ad per hard page. A location for the first ad can be selected on the first 

\ 5 page and subsequent ads follow every n channel slots. The same ad is repeated every « th slot. 
This method of repeating every r& channel slot is true for both PIP and non-PIP versions. 
Typically, as a user turns channels off, the spacing of these ads remains constant (every n 
channel slots). In the event that there are not enough channels to continue this spacing, ads 
will appear at the end of the grid listings. 

20 Parent Channel ads are related to a specific channel located directly above the ad. A 

Parent Channel ad is attached to its adjacent "parent" channel (that is, the ad follows the 
parent channel). As it is desirable to limit the number of Channel ads seen on any one screen, 
the number of Parent ads will typically be limited. Additionally, if the parent channel is 
turned off, the ad will typically be displayed at the bottom of the grid. 

25 Fixed Position Channel ads are located in one specific location, y (where y is some 

number) channels down from the top of the grid. If y is greater than the number of channels 
in the grid, the ad will be located at the end of the grid. 

. Except as noted above regarding Parent and Fixed Position Channel ads, Channel ads 
will typically be spaced so that no more than one Channel ad is displayed at one time. 

30 In one embodiment, Channel ads page vertically along with the channel listing 

information. These ads remain in a fixed position when the grid is scrolled horizontally. 
The user can highlight these Channel ads just as any show title can be highlighted. When 
highlighted, these Channel ads display additional information in the info, box just as when 
any channel is highlighted. 

35 Channel ads are typically surrounded by bevels just like any show tile. Channel ad 

highlighting is typically similar to Panel ad highlighting. In one embodiment, when a user 
highlights a Channel ad, the bevels change to a flat (non-beveled) yellow border. When a 
Channel ad show is set to record the border turns red (dark red when not highlighted, 
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light/bright red when highlighted). When a Channel ad show is scheduled to watch, the 
border turns orange (dark orange when not highlighted, light/bright orange when highlighted). 

5 In one embodiment, Channel ads can have multiple, sequential info, box "screens" 

of information. The availability of this additional information is indicated by an "i" icon. 
The user can access the additional information by pressing the info, button. 

In one embodiment, if a Channel ad is highlighted, has show information associated 
with it, and the advertised show is currently on, the user may tune directly to the related 

10 program by pressing the Left Action button (the Blue button which is labeled "Watch") or 
by pressing the Enter/Select button on the remote. Pressing the Watch button also places the 
show in the Record/Watch Schedule for the duration of the show. If the show is not currently 
on, pressing the Left Action button places the show in the Record/Watch Schedule for future 
auto-viewing; pressing the Enter/Select button tunes to the channel related to the show in the 

15 Channel ad. Shows added to the Record/Watch Schedule may be set to be viewed: once, 
daily, or weekly. The Watch feature and related Action button labels operate in the same way 
as if scheduling a show to watch from the Grid. 

In one embodiment, if a Channel ad has show information associated with it, the show 
may be recorded by highlighting the ad and pressing the Right Action button (the Green 

20 button, labeled Record). If the show is already being delivered in the television signal, 
recording begins immediately and the show is placed in the Record/Watch Schedule for the 
duration of the show. If the show is on in the future, the show is added to the Record/Watch 
Schedule for recording. Shows added to the Record/Watch Schedule may be set to be 
recorded: once, daily, or weekly. The Record feature and related Action button labels operate 

25 in the same way as if recording a show from the Grid. 
Channel ads can be dynamic. 

5. Placeholder Ads 

In one embodiment, when the Guide is first setup, the initial download of information 
30 will not have been received. The Panel ad spaces must be filled with Placeholder ads that are 
stored in ROM. These ads must be "timeless" as they will appear each time a TV is set up, 
either for the first time or after a power outage. 

One use for the Panel ad space is for help text. Help text that draws the user to select 
the ad space could serve as a "tutorial" on how to access Panel ads, the additional information 
35 on info, screens, and how to Watch and Record from ads. 
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6. foill screen ads. 

When the viewer first enters the EPG, the EPG can display a full screen ad, such as 
5 an ad that would be displayed in the Ad Window. The viewer can interact with the full screen 
ad in the same manner in which the viewer can interact with the Ad Window. That is, the 
viewer can instruct the EPG to record, or to add to the watch list, the infomercial or program, 
if there is one, that is associated with the advertisement. 

10 7. Automatic watch channel. 

Rather than have the last channel watched as the first channel tuned the next time that 
the viewer turns on the television, a channel selected by the viewer could be automatically 
tuned. In one embodiment, the viewer indicates the Automatic watch channel in the Watch 
List Function of the EPG. In another embodiment, a broadcaster sends an on-screen query 

15 to each viewer to enter a command if the viewer wants the broadcaster's channel to be the 
first Watched channel when the viewer first turns on the television. 

8. Ad Features. 

Ads may feature, among other things, a graphics field, a text field or a combination 
20 of a graphics and text field. 

Graphics are typically presented in 8 bit/pixel (using "320 mode"), 4 bit/pixel (in "640 
mode") and 1 bit/pixel images. In some embodiments, there will be memory limitations. In 
embodiments with such memory limitations, it is expected that Panel ads will contain 
graphics no larger than 25% of the ad area when 4 or 8 bit/pixel graphics are used. 1 00% of 
25 the area may be used for a 1 bit/pixel graphic. Channel ad graphics will typically, but not 
necessarily, be limited to the channel logo portion of the ad. (The use of the word "typically" 
here, and elsewhere in this application, means "typically, but not necessarily.") The 
remaining portion of the Channel ad will typically be text only. 

Displayed text will typically have the following characteristics: 
30 available normal and condensed 1 i8 and 24 point fonts 

oblique version of the fonts 
underlining 
bold 

centering 

35 left and right justification 

color can be selected once per line 

Text could also be displayed as a 1 bit/pixel bitmap in the Panel ad areas only. 
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Background colors will have an impact on the overall look and usability of the Guide. 
The following describes a typical embodiment. 

Panel ad background colors may be selected by the advertiser and will typically be 
subject to luminance constraints set forth below. 

Channel ad background colors may be restricted.. Show tile background colors are 
used as keys for show categories (movies, sports, etc.) and actions taken on a show (set to 
record or watch). While most any background color could be displayed it is desirable to 
maintain the integrity of the show tile color schemes. Therefore, it is likely that a limited set 
of background colors or a set of colors which can not be used will be specified for advertising 
agencies to use when developing Channel ad creative. Channel ad backgrounds will typically 
be subject to luminance constraints set forth below. 

The Info, box background will typically be gray and typically can not be changed by 
the advertiser. 

There are typically limitations on the luminance of the colors in the ads. If the 
luminance is set too high, the screen image will blister. These limitations will be set, 
according to the embodiment, and communicated to the advertisers for their development 
consideration. Ads that do not comply with luminance restrictions for the particular 
20 embodiment will be subject to default override limitations. 

In one embodiment, the viewer can interact with the ads and the television. For 
instance, Tune-in ads will allow the viewer to tune directly to a show in progress from a 
highlighted ad block assuming the ad block has program information associated with it. An 
in progress show associated with an ad is directly tuned by pressing either the Enter/Select 
25 button or the Left Action button (the Blue button labeled "Watch"). 

Direct-record ads will allow the user to record a show in progress or scheduled to be 
on in the future from a highlighted ad block. There is no practical limit on how far into the 
future a direct-record associated show may be scheduled to air. A show associated with an 
ad is recorded by pressing the Right Action button while the ad is highlighted. The user may 
30 select a record frequency of once, daily or weekly. # From an ad, the user presses the Right 
Action button (the Green button labeled "Record") to place the show in the Record Schedule. 
In the event that the show is currently on, pressing the Right Action button while highlighting 
an ad allows recording of the show in progress. The show title is also placed in the Record 
Schedule until the show ends in the event the user wishes to modify the record frequency to 
35 . daily or weekly. 

Watch ads consist of a program advertised in any ad space. The program advertised 
may be placed into the Watch Schedule as long as the ad block has program information 
associated with it. There is no practical limit on how far into the future an associated show 
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may be scheduled to air. The Watch feature operates much the same way as the Record 
feature, except that it tunes the television ("TV") to the show rather than recording it. If a 

5 user is watching TV, the channel automatically changes to a show placed in the Watch 
Schedule when the show begins. If the TV is turned off when a show in the Watch Schedule 
is scheduled to begin, the TV is turned on and tuned to the desired channel (TV 
implementations only, not VCR.) The user may select a watch frequency of once, daily or 
weekly. From an ad, the user presses the Left Action button (the Blue button labeled 

10 "Watch") to place the show in the Watch Schedule. In the event that the show is currently 
on, pressing the Left Action button while highlighting an ad results in tuning directly to the 
show. The show title is also placed in the Watch Schedule until the show ends in the event 
the user wishes to modify the watch frequency to daily or weekly. 

Ads may have multiple levels of information. Typically, First Level Information is 

1 5 the ad copy and/or graphics that are presented on screen with no user action. This comprises 
the Panel and Channel ad areas. 

Typically, Second Level Information (if provided by the advertiser) is automatically 
made visible ("Auto-Open") when the user highlights an ad block by scrolling onto it. This 
secondary information is presented in the info, box when a Channel ad is selected and in an 

20 automatically expanded version of the info, box that covers the entire channel grid area when 
a Panel ad is highlighted. The "i" icon on the ad, placed at the advertiser's discretion, 
indicates there is more information available for that ad. The second level information may 
be text and/or graphics depending on memory availability. 

Typically, Third Level Information (if provided by the advertiser) availability is 

25 indicated by the info, button "i" on a Second Level information screen. Pressing the info, 
button accesses this information and cause the information box to expand for Channel ads to 
cover the entire grid area. This information can be multiple pages long. Pressing the info, 
button successive times cycles the user through the multiple pages. Pressing the info, button 
from the last available screen causes the information box to contract to its original size for 

30 all ads. The third level information may be text and/or graphics depending upon memory 
capabilities. 

Ad Blocks can be dynamic. Memory permitting, the Panel ad graphics and/or text and 
information box text may change every X (where X is some number) seconds rotating through 
a limit of N (where N is some number) different graphical or textual executions. There is the 
35 capability to limit the number of dynamic ads displayed at any one time. 

Ad duration and start time/end time can be scheduled and/or dynamic. In one 
embodiment, ads are to be displayed at a given start time with a related end time. The time 
between the start and end is the ad's duration. The minimum duration increment is typically 
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60 seconds. In one embodiment, an ad will not be replaced automatically when an ad's end 
time arrives. Ads will only change when the user's actions cause a new "hard page," or new 

5 section of the guide to appear (e.g. going from the Grid to Sort). 

Ads can rotate. For example, different ads can appear each time the user enters the 
same page/section of the Guide. There is no hard limit on the number of ads placed in 
rotation. Ads can be assigned a priority with the ad of the highest priority being displayed 
the first time a hard page or section is accessed. Then the second priority ad is displayed the 

10 next time the user views this page and so forth. The priority counter is page dependent, 
meaning that if the user views the first page for a third time, they will see the third priority 
ad on that page and if they then scroll to the second page for the first time, they will see the 
first priority ad on the second page. 

Ads may differ by the section of the Guide being viewed. For example, if a user is 

1 5 viewing the Sports theme area, an ad for ESPN Sports Center may appear, whereas a different 
ad was presented when the user was on the main grid. 

The EPG can determine which advertisements to display depending upon the 
advertisement being displayed on the television channel that the viewer was watching 
immediately before entering the EPG. That is, if a Toyota advertisement was being shown 

20 on the channel that the viewer was watching at the time that the viewer entered the EPG, then 
the EPG can be timed to display a correlative Toyota advertisement in some portion of the 
EPG, e.g., the Ad Window, a 'television program. 

In one embodiment , the EPG tests the Viewer Profile to determine which ad to 
display at various times during the viewer's session with the EPG. The EPG can assign Ad 

25 and Page priorities to represent the advertisers' investment and the relative viewer's profile. 

Graphically dynamic ads typically present different graphics every jc seconds (where 
x is some number, with x as small as 1 .0 second) rotating through n (where n is some number) 
graphical or textual executions. Typically, only a limited number of these ads will be 
displayed at any one time (likely a maximum of 1 per screen) as busy screens will decrease 

30 the effectiveness of the ads and the utility of the Guide. 

Ads must be "identifiable" and "accessible" once placed in memory in order to allow 
advertisers to "pull" an ad, to update an ad, or to correct errors in transmission. 

G. IMPROVED PRODUCT INFORMATION ACCESS BY THE VIEWER 
35 1. Ad Window product detail. 

The viewer can highlight the Ad Window to locate additional information about the 
product advertised. In one embodiment, the viewer highlights the Ad Window by pressing 
the arrow/directional navigational keys of the remote control device to navigate the remote 
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control device pointer to the location of the Ad Window on the on-screen television monitor 
display. When the remote control device pointer is located at the Ad Window on the on- 

5 screen television monitor display, the on-screen display of the Ad Window will be 
highlighted. In one embodiment, the color of the Ad Window itself will become brighter or 
show a lighted effect. In another embodiment, the color of a border surrounding the Ad 
Window will become brighter or show a lighted effect. Highlighting the Ad Window will 
cause additional text describing the product to be displayed in the detail box are of the EPG 

10 Grid Guide. Alternatively, the EPG provides the producers of infomercials with the 
opportunity to provide the viewer with the opportunity to view a video clip about the product 
being advertised. 

The Ad Window can be optionally interactive. The Internet address of a web site 
containing information relevant to the ad being displayed in the Ad Window can be displayed 
1 5 in the Ad Window as a web site address, as an icon, or in some other graphical presentation, 
such as a stylized "i" indicating additional interactive information. Furthermore, the viewer's 
interaction with the Ad Window will be monitored by the EPG to record as part of the 
viewer's profile. 

20 2. Ad Window product-related recording 

The EPG provides viewers the opportunity to access extended product information 
about which the viewer is interested. Because of the cost of buying advertising time, a 
growing number of product manufacturers and marketers produce infomercials about their 
products. Because of the cost of air-time, many manufacturers and marketers buy relatively 

25 inexpensive air time for their infomercials according to off-prime-time schedules, often on 
non-prime channels. The EPG.provides the viewer the opportunity to record an infomercial 
that is broadcast at a time, or on a chiannel, that would be inconvenient for the viewer to 
watch real-time. If the Ad Window displays information about a particular product, pressing 
a record button will instruct the EPG to record an infomercial, to the extent that one is 

30 scheduled for a future time. Alternatively, the viewer can designate the infomercial for the 
Watch List. 

3. Ad Window program-related recording 

The EPG provides viewers with additional opportunities to instruct the EPG to record 
35 or watch a future-scheduled television program, The Ad Window can display information 
about a future-scheduled television program. If the viewer is interested in recording the 
program, the viewer can instruct the EPG to record the future-scheduled program. In one 
embodiment, the viewer presses record button on the remote control device to instruct the 



-35- 



WO 99/04561 



rCI7US98/15093 



1 

EPG to record the future-scheduled program. Alternatively, the viewer can instruct the EPG 
to add program to the Watch List. Alternatively, the viewer can view a video clip about the 
5 program. 

H. CREATION OF A VIEWER'S PROFILE 

1. Collecting viewer profile information. 

The EPG requests that the viewer provide certain profile information, including but 

10 . not limited to: the viewer's zip code; television, cable, and satellite services to which the 
viewer subscribes; the length of said subscriptions; the type of television; the age of the 
television; where the television was purchased; the viewer's top favorite channels; the 
viewer's favorite types of programs; and the times during which the viewer is most likely to 
watch television. If the viewer declines to provide this information, the EPG will attempt to 

1 5 "learn" the information as described below. 

In one embodiment, the EPG is capable of distinguishing between individual viewers 
and develops individualized profiles. For instance, in one embodiment, each viewer has an 
individual PIN or other identification number. In another embodiment, each viewer uses an 
individualized remote. In yet another embodiment, there is an absence of a way to distinguish i 

20 one viewer from another. In that case, the profile is developed for the "family." . ■ ; ' 

\J "o* ■-! ; /• \ Every time the viewer interacts with the EPG or the television, the EPG records the 
s r ' f :-g3 viewer s actionspnd the circumstances surrounding those actions. For instance, when the 
viewer changes'channels, the EPG records, among other things, information about the first 
channel, the changed-lo channel, the time that the change was made, the identification of the 

25 programming that was displayed on the first channel, the identification of the programming 
that was displayed on the changed-to channel, the time of the change, the identification of any 
advertisement that was displayed on the first channel at the time of the change, the 
identification of any advertisement that was displayed on the changed-to channel, and 
whether the viewer changed channels while in one of the EPG modes, as opposed to being 

30 in the television mode. The EPG will also record every instruction by the viewer to record 
or watch a program, whether the instruction is Once, Daily, Weekly, or Regularly. The EPG 
will also record whether the viewer changes the volume of the television audio, and if so, 
what circumstances surrounded the change in volume. If the viewer changes channels while 
in one of the EPG modes, then the EPG records information abo ut what w asjjisplay£djn each 

35 of the End ows of the EPG UI before a nd after the changed 

The EPG also records information when there is an absence of interaction between 
the viewer and the television or the EPG. For instance, the EPG will record whether a viewer 
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continues to view an advertisement rather than changing channels. The EPG calculates and 
records the entire duration of the time that the television is on in any particular day. 

5 The EPG also records information surrounding the viewer's interaction with external 

sources of information, such as the Internet. For instance, the EPG records each search query 
criteria initiated by the viewer, the Search Engine used to make the search, the items selected 
by the viewer from the search response, interaction by the user with Internet sites, and viewer 
interactions with the EPG during the same time-frame as the viewer interacts with the 

]0 Internet. 

An alternative to the above-described individual viewer profile information collection 
would be to provide on-screen survey queries. That is, the EPG could display an offer on- 
screen that would tell the viewer to call a toll-free number for the purpose of reading an on- 
screen encrypted number for the survey in exchange for a gift certificate. The offer could be 
1 5 made only to viewers watching a particular program or particular advertisement at a particular 
time. Survey responses would provide useful information further survey customization, 
customizing the guide, and targeting advertising. 

2. Analyzing and characterizing viewer profile information. 

20 The viewer profile information (data collected concerning, and surrounding, a 

viewer's interaction withTHTtelevlsion, t he EPG (including the recording and watching 
functions), the Internet, the World Wide Web, and any other sources of information external 
to the EPG, but through which the viewer interact)) can be sent to a computer at the head end 
of television distribution for analysis, or in the alternative, can be analyzed by the EPG. 

25 Information about the viewer is captu red on an ongoing basis. Similarly, viewer 

profile data is updated on an ongoing basis. Accordingly, the viewer profile analysis program 
(the "Profile Program"), can be repeated at some time interval to incorporate additional 
information about the viewer that has been captured since the last analysis. Alternatively, 
the Profile Program is a real time program that processes each discrete item of information 

30 about a viewer as the data is captured. 

The viewer profile analysis program (the "Profile Program"), may be resident at the 
head end, in the Internet, included as part of the EPG, or distributed among these various 
possible locations. The Profile Program performs a variety of different types of analysis on 
the viewer profile data. For instance, the Profile Program performs simple statistical analysis 

35 of the data collected. The Profile Program accumulates, among other things, the number of c \ } r ,.?- 
times that the viewer: interacted with the EPG during a particular viewing session; p^rmed^^ i- 
particular types of interactions with the EPG; watched a particular channel; interacted with 
the Internet during a particular viewing session, interacted with a particular website; watched 
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and/or recorded and/or scheduled to watch a program with a particular type of theme (e.g., 
comedy, sports, drama, movie; sitcom, science fiction, adventure, mystery, documentary, 

5 cooking, travel, etc.); and watched and/or recorded and/or scheduled to watch a program with 
a particular type of subject (e.g., golf, tennis, football, basketball, baseball, animals, food, 
etc.), or a particular actor or actress. The Profile Program also calculates the duration of each 
viewing and compiles, among other things, statistics a bout the times of day an d days of the 
week during which the viewer watches television, interacts with the EPG, or interacts with 

1 o the Internet or the World Wide Web. 

Using the basic viewer profile data and the simple statistics collected about a 
particular viewer, the Profile Program "learns" to recognize a finer breakdown about the 
various types of data collected and then uses the learned information to describe a "Viewer 
Preference.". For instance, if the Profile Program detects that the viewer watches sports 

1 5 programs, and that a number of sports programs are basketball games, the Profile Program 
analyzes the teams involved in the programs watched. The Profile Program is able, in this 
manner, to determine whether the viewer is a fan of a particular team. If so, the Profile 
Program records the viewer's team affiliation as a Viewer Preference. 

The Profile Program performs multiple levels of sophisticated analysis and learning 

20 involving numerous comparisons of the basic viewer profile data and the simple statistics 
collected about a particular viewer to develop Viewer Characteristics. In this way, the Profile 
Program develops a multi-dimensional profile of the viewer. For example, once the Profile 
Program detects a Viewer Preference, the Profile Program compares, e.g., the number of 
times that the viewer interacts with the EPG or an external information source such as the 

25 Internet/World Wide Web, during a telecast of a program that relates to the Viewer 
Preference (e.g., a basketball game involving the viewer's favorite team) with, e.g., the 
number of times that the viewer interacts with the EPG or an external information source such 
as the Internet/World Wide Web, during a telecast of a program that does not relate to the 
Viewer Preference. 

30 Further, the types of interactions in both sets of circumstances are analyzed. In this 

way, the Profile Program determines Viewer Characteristics relating to, among other things: 
attention span; general interest in product advertisements; interest in specific types of product 
information; propensity for impulse buying; correlation of impulse buying habits to price 
ranges, product types, and advertising formats; interest in recording and/or watching future^ 

35 scheduled programs; interest in accessing additional levels of information concerning, 
television programs; and interest in accessing additional levels of information concerning 
product advertisements including the correlation of such interest with the Viewer Preferences. 
Over time, with sufficient data, the EPG characterizes the viewer's sense of humor, 
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chronological age, activity age, whether the viewer is married, whether the viewer has 

children, whether the viewer has a pet and what type of pet the viewer likely has, whether the 
5 viewer is interested in buying a particular type of appliance, whether the viewer is 

considering buying a car, the viewer's likely political affiliations, and a broad range of 

various other Viewer Characteristics. 

Yet further, the Profile Program analyzes an individual's Viewer Profile as compared 

to the Viewer Profiles of others. With this cross-comparison analysis, the Profile Program 
1 0 can determine the likelihood that the subject viewer will prefer or be interested in a particular 

subject, product, theme, movie, episode, etc. based on comparisons to similar Viewer 

Profiles. 

I. UTILIZATION O F VIEWER PROFILE INFORMATION TO CUSTOMIZE VARIOUS ASPECTS 

15 OF THE PPG 

The EPG and Profile Program use the basic viewer profile data, the simple statistics 
collected about a particular viewer, Viewer Preferences and Viewer Characteristics 
(collectively, hereinafter, the "Viewer's Profile") to customize various aspects of the EPG. 
The viewer has the option to block any of these automatic customization features in the EPG 

20 Setup Mode. One aspect of the EPG that will be customized is the order of the channel slots 
presented in the Grid Guide. The order in which the channel slots are presented can be 
customized to present the viewer's favorite channels at the top^eginning of the Grid Guide 
in descending order according to the Viewers Profile. 

In one embodiment, the order of the channel slots is customized according to the day 

25 of the week and the time of day in accordance with the Viewer's Profile. For instance, if a 
particular viewer frequently watched Nick at Nite on weekday evenings from 7pm to 10pm, 
then the EPG automatically tunes the television when turned on between 7 pm and 10pm, to 
the appropriate Nick at Nite channel and formats the Grid Guide to show the Nick at Nite 
channel as the first channel in the Grid Guide. If the same viewer typically watched ESPN 

30 during daytime hours on Saturday and Sunday, then the EPG automatically tunes the 
television when turned on between, e.g., 7 am through 7 pm on Saturday and Sunday to one 
of the ESPN channels and formats the Grid Guide to show the ESPN channels as the first 
several channels in the Grid Guide whenever the viewer enters the Grid Guide between, e.g., 
7 am through 7 pm on Saturday and Sunday. 

35 At the viewer's option, the EPG and Profile Program use the basic viewer profile 

data, the simple statistics collected about a particular viewer, Viewer Preferences and Viewer 
Characteristics to perform automatic surfing. At the viewer's option, auto surfing can be 
performed during real-time advertising telecasts. At the viewer's further option, auto surfing 
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can be performed in PIP Watch Function, allowing the viewer to watch the program currently 
tuned in the main Picture Window, while providing auto surfing in the PIP Window. 
5 Alternatively, at the viewer's option, auto surfing can be performed in PIP Watch Function, 
allowing the viewer to watch the program currently tuned in the PIP. Window, while 
providing auto surfing in the Main Picture Window. Still further, the viewer can choose the 
option of selecting a different advertisement to watch, or manually surfing channels of the 
viewer's choice. 

10 At the viewer's option, the EPG and Profile Program use the basic viewer profile 

data, the simple statistics collected about a particular viewer, Viewer Preferences and Viewer 
Characteristics to populate the Record List and/or the Watch List with programs that are 
likely to suit the viewer's interests. In one embodiment, searches for this type of information 
are conducted at a central computer at the head end. In another embodiment, queries are 

1 5 constructed and fed to an Internet search engine. 

At the viewer's option, the EPG and Profile Program use the basic viewer profile data, 
the simple statistics collected about a particular viewer, Viewer Preferences and Viewer 
Characteristics to search for news stories that are likely to suit the viewer's interests. The 
problem that is solved is automatically (without an editorial staff) choosing news stories 

20 from multiple news feeds for display to a particular viewer in a news service. The content 
of the audio portion of the news broadcast is digitized and can be stored at a central computer, 
on one or more web sites, on DVD's (both video and audio recordings) local to the particular 
viewer's television system, or in memory at the particular viewer's television system. In 
addition to the audio content, video recordings of the news stories can also be stored. 

25 The Viewer's Profile, and in some embodiments, specific input from the viewer, is 

then used to construct data-mining search queries to locate and deliver content that matches 
the viewer's profiled interests and/or the viewer's specific requests for information. The 
news stories are then indexed (as described elsewhere in this disclosure). The EPG presents 
the viewer with the customized index. In this way, the viewer selects the news stories for 

30 viewing in much the same way as the viewer selects television programs that the viewer 
wants to watch or record. Furthermore, web sites containing additional information 
concerning the indexed news stories can be posted, e.g., as part of the detailed description 
area text presented at the time that the viewer highlights a particular news story for viewing. 
In one embodiment, Theme Guides provide "Smart Sorting" based on the Viewer's 

35 Profile (which is explained more fully elsewhere in this application). That is, if a program 
is on two channels, the system will select the best channel based on which of the two 
channels the viewer watches more often. In one embodiment, the Theme Guides are further 
customized according to the Viewer's Profile. For instance, an information broadcast packet 
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sent with the scores is used to order the score in the sports guide consistent with the Viewer's 
Profile. For instance, the score for a game involving the Boston Red Sox would display the 

5 scores for the Red Sox first for a viewer in Boston. 

During set up procedures, the EPG provides for automatic channel map selection. 
All channel maps in the viewer's zip code are downloaded. Zip code related options are 
displayed. In one embodiment^ the viewer is asked to identify information necessary for the 
television to select the appropriate channel mapping option, but the television automatically 

10 selects the appropriate channel map. For instance, the viewer is asked to identify, e.g, the 
distribution service to which the viewer subscribes, e.g., Colonial Cable, and a particular 
channel map, e.g., does the viewer receive HBO on channel 43. In this way, the viewer 
identifies the information necessary for the television to select the appropriate channel map. 
Alternatively, the viewer is actually asked to select the channel map, e.g., "if you have 

15 Colonial Cable and get HBO on channel 43, pick this channel map." 

J. UTILIZATION OF VIEWER PROFILE INFORMATION TO PROVIDE CUSTOMIZED 

PRESENTATION OF ADVERTISING TO THE VIEWER 

The EPG and the Profile Program use Viewer Profile information to tailor the 

20 presentation and scheduling of advertisements to the viewer and to customize the presentation 
of the EPG for the user. For instance, the EPG uses Viewer Profile information to determine 
whether to notify the viewer about scheduling for a program involving the viewer's favorite 
team, a talk show involving astar player from that team, etc. The EPG is capable of such 
customized notification/advertisement through e.g., an advertisement in the Ad Window, or 

25 through an advertisement in a Virtual Ad Channel Slot. 

Additionally, the EPG and the Profile Program use Viewer Profile information to 
customize the presentation and/or scheduling of telecast advertisements that are viewable 
during the real time telecast of the television program that the viewer is watching. One 
example is customizing an overlay message to an advertisement on a local geographic basis. 

30 For instance, the EPG knows the geographic location of the individual viewer. The 
broadcaster can packet match on the zip code to customize the message so each zip code gets 
a different message, i.e., the 3 Burger Kings in the viewer's local area. In one embodiment, 
the customized messages can be preloaded by zip code into the memories of particular 
viewers' EPG's. The preloaded messages can be transmitted by a head end during off hours 

35 and stored in the viewer's terminal for use when the advertisement runs, e.g., during a 
television program or in a video clip in the Ad Window. The electronic trigger to run the 
message can be transmitted along with the television signal in real time and can identify the 
messages stored in the user terminal that need to be applied. 
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In another embodiment, the customized messages are narrowcast with the televised 
advertisement. One way to narrowcast the customized messages is to embed the customized 

5 information in the advertisement video stream. Another way is to transmit a digital 
"watermark" in the video stream of the advertisement. 

In one embodiment, customization of real-time viewing of advertisements is achieved 
by providing multiple channels of advertising, by tuning the television automatically to a 
particular advertising channel at the time during the telecast of the television program during 

1 o which an advertisement is scheduled to occur, and by then tuning the television back to the 
viewer's chosen television program at the conclusion of the advertisement. In another 
embodiment, a service monitors telecasts for advertisements as they are telecast on a 
particular channel and inserts a change channel command in the Vertical Blanking Interval 
(the "VBI") when an ad is telecast, said change channel command causing the television to 

15 tune to a particular channel for a telecast of an advertisement suitable to the Viewer's 
Preferences. 

Viewer Profile information can be reported, as with, for instance, statistical reports 
of Viewer Profile information for many viewers. These reports could be provided for 
analysis by advertisers, head end operators, Guide producers, or others, to determine, among 

20 other things, marketing customization opportunities, narrowcasting opportunities, program 
detail information requirements, and program distribution scheduling requirements. 

The EPG will attempt to capture the approximate initial purchase date (e.g., first turn- 
on date) of any television/entertainment system components. The EPG can notify the user 
at the appropriate time after the initial purchase of opportunities such as purchasing an 

25 extended warranty from the manufacturer. In one embodiment, the terminal equipment is 
separately addressable providing that such notification messages can be sent in the VBI to the 
appropriate viewer. Based on the Viewer Profile, the extended warranty offer could be 
tailored to the viewer's financial situation. 

Another way that the EPG uses Viewer Profile information is in connection with 

30 "access-content" customization of the advertising messages displayed by the EPG. Viewer 
Profile information will include the television program that the viewer was watching 
immediately before entering the EPG. The EPG can display different ads in the Guide or 
Service based upon the content of the television program that the viewer was watching before 
entering the EPG or one of the special data services accessible through the EPG. The 

35 "access-content" advertising strategy provides a much more refined way of targeting the 
consumer. For example, consider two viewers who are both watching television at 8:00 p.m. 
on a Tuesday night. When the one viewer who has been watching "Nova" enters the EPG, 
the EPG might display an advertisement for educational computer; whereas when the second 
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viewer who has been watching Major League Baseball enters the EPG, the EPG might 
display an advertisement for Goodyear Tires. 

5 In one embodiment of this invention, a data base of advertising messages and virtual 

channel ads is stored in RAM at the viewer terminal or is accessible at a web site if the viewer 
terminal has an Internet connection. In either case, the advertising items in the data base are 
labeled with coded categories that correspond to coded category labels assigned to the telecast 
television programs. (Preferably, these are the same categories that are used to sort the 

10 programs in the on screen category or theme guide.) The category labels of the television 
programs could be stored in RAM as part of the EPG data base and retrieved from the 
applicable Show Information Package ("SIP") based on the information from the real time 
clock and the tuner setting. This information identifies a time and channel that points to the 
applicable SIP. After the category label of the last program the viewer was watching in the 

15 television mode is retrieved from the EPG data base, this label is matched to the 
corresponding label in the data base of advertising messages and virtual channel ads stored 
in RAM. In FIG. 1 of the drawing, the advertising items to which the labels are attached are 
displayed in ad windows 14 and 16 and the virtual channel ad displayed on tile 52 as 
described above. 

20 Yet another way that the EPG uses Viewer Profile information is in connection with 

"adjacent-content" customization of the advertising messages displayed by the EPG. Viewer^ 
Profile information will include identification of the content that the viewer has currently 
highlighted in the EPG or related data service. Using this method, the EPG displays different 
advertisements depending upon, e.g., which show the viewer has currently highlighted in the 

25 Grid Guide, what sport is highlighted in a sports data service, or what type of news is 
highlighted in a news service (international, local, etc.). 

The EPG can select advertisements from various possible locations, including but not 
limited to: a library of advertisements stored at the viewer's terminal in RAM that have been 
downloaded through the VBI, stored at the head-end, or accessible through an EPG link to 

30 the Internet/World Wide Web. The advertisements may be in the form of graphics, text, 
video clips, audio clips, and combinations thereof. Each advertisement can be assigned 
theme codes, profile codes, and other selection intelligence. In one embodiment, in order to 
customize the advertising display, the EPG searches the library of available advertisements 
to locate advertisements that match criteria set by the advertisers for "access content," 

35 "adjacent content," and/or Viewer Profile information. In another embodiment, the EPG 
selects advertisements for display according to pre-established selection criteria. 

The disclosures of the following patent applications are incorporated fully herein by 
reference: International Application WO96/07270; Application No. 60/053,330 filed July 21 , 
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1997; Application No. 60/061,1 19 filed October 6, 1997; and Application No. 60/055,237 
filed August 12, 1997. 

5 In one embodiment, the advertisements in the library are assigned to themes; the 

history of use of an on-screen theme menu or program guide is recorded; and the history is 
analyzed by the EPG microprocessor to decide which advertisement to display. 

For example, a particular advertisement for automobiles might be assigned to a sports 
event theme. In a simple implementation, this automobile advertisement would be selected 

1 o for display, if the users of the particular EPG selected sports as a theme more frequently than 
any other theme during a prescribed period of time. FIG. 7 represents the on screen display 
for the top level theme screen; and FIG. 8 represents the on screen display for the second- 
level theme screen. A theme selection could be recorded when a viewer highlights a theme 
in FIG. 7, such as "Sports". Selecting a theme brings up a screen listing, by time, channel, 

1 5 and title, of the programs that are consistent with the selected theme on a second-level theme 
screen, an example of which is shown in FIG. 8. The history of use could be recorded in a 
memory by overwriting the oldest data stored in the memory. If desired, a more sophisticated 
analysis could be used. Thus, the frequency of selection could be weighted to favor more 
recent selections over older selections or themes could be combined to determine which 

20 advertisement to display. 

In another embodiment, the advertisements in the library are assigned to particular 
television programs or classes of television programs; the history of use of the information 
box of the EPG is recorded, in terms of frequency of the visits, time spent during a single 
visit, and/or total time of all the visits; the information boxes are correlated to the television 

25 programs, and the results are analyzed to decide which advertisement to display. Instead of 
the information box, any other area of the EPG screen could be monitored in similar fashion 
to decide which advertisement to display. In each case, the advertisements in the library are 
assigned to the types or subjects of information displayed in the monitored area so as to target 
better the advertisements to the interests of the users. 

30 In another embodiment, the advertisements in the library are also assigned to 

particular television programs or classes of television programs in terms of channel and time; 
the tuner is monitored; the channel and time are correlated to the television programs, and the 
results are analyzed to decide which advertisement to display. For example, an advertisement 
for brand name athletic shoes with a popular basketball star could be assigned to basketball 

35 programs. The shoe advertisement would be selected for display if the viewer of the 
particular EPG entered the EPG while watching a basketball game. 

In another embodiment, the advertisements in the library are also assigned to 
particular television programs or classes of television programs; the history of television 
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programs entered into a "record-watch list" as shown in FIG.6 is recorded; and the results are 
analyzed to decide which advertisement to display. 

5 The time of the monitored event can also be taken into account in order to distinguish 

between multiple users of the same EPG or related television receiver. The assumption is that 
the people using the EPG and watching television at different times of the day have different \^ iA ' * 
interests-housewives may use the EPG more in the morning, children may use it in the early / h . 
evenings, and men who work outside the home may use it on Sunday afternoons. * — ^ 

10 History of use as described above can be combined with the "access-content" model } y 

described in Application No. 60/055,237 to further pin-point advertisements to the user's ^ ■ >, 
interests. Thus, if the users of the particular EPG selected comedies as a theme more 
frequently than any other theme during a prescribed period of time, three advertisements 1 { ; ;' 
might be flagged and the final selection made therefrom depending upon which type of 

15 program the viewer was watching on television before switching to the on-screen EPG. 

Illustrative Embodiments 

The embodiments of the invention described herein are only considered to be 
preferred and/or illustrative of the inventive concept; the scope of the invention is not to be 
20 restricted to such embodiments. Various and numerous other arrangements may be devised 
by one skilled in the art without departing from the spirit and scope of this invention. For 
example, alternative display formats are possible. 



25 
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CLAIMS: 

1 . A method for navigating about an on screen television interactive program 
guide comprising the steps: 

displaying a list of television programs vertically in a first area of a screen of a display 
monitor; 

displaying an advertisement in a second area of the screen located horizontally 
adjacent to the first area; 

moving an on screen cursor vertically to highlight one of the television programs in 
the first area; and 

moving the cursor horizontally from the first area to the second area to highlight the 
advertisement. 

2. The method of claim 1, additionally comprising the step of activating a 
function with respect to the highlighted advertisement. 

3. The method of claim 2, in which the function is displaying on the screen 
details about the highlighted advertisement. 

4. The method of claim 3, in which the details are displayed in the second area 
instead of the advertisement. 

5. The method of claim 3, in which the details are displayed in a third area of the 
screen different from the first and second areas. 

6. The method of claim 2, in which the advertisement promotes a future 
television program and the function is storing the time and channel of the future television 
program for later recording or viewing. 

7. The method of claim 2, in which the function is establishing a link to an 
Internet website for display of still images or video on the screen in the second area instead 
of the advertisement. 

8. The method of claim 2, in which the function is establishing a link to an 
Internet website for display of still images or video in a third area of the screen different from 
the first and second areas. 
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9. The method of claim 1 , in which the moving step highlights the advertisement 
by display of a border around the second area. 

5 

10. The method of claim 9, in which the moving step highlights the one program 
by display in a color that contrasts with the other programs. 

11. A microprocessor programmed to operate with a display monitor having a 
10 screen and a RAM so as to generate signals that display television program listings stored in 

the RAM in a first area of the screen and other text or images stored in the RAM in a second 
area of the screen horizontally adjacent to the first area, the second area being divided into 
third, fourth, and fifth vertically arranged areas each of the third, fourth, and fifth areas 
having the same height-to-width aspect ratio as the screen and 1/9 the area of the screen. 

15 

12. The microprocessor of claim 1 1 , additionally programmed so as to generate 
signals that highlight one of the program listings in the first area. 

13. The microprocessor of claim 12, additionally programmed to set a television 
20 tuner so as to generate signals that display in the third area the current television program 

represented by the highlighted program listing. 

14. The microprocessor of claim 13, additionally programmed so as to generate 
signals that display an advertisement for a future television program in the fourth area. 

25 

15. The microprocessor of claim 14, additionally programmed so as to. generate 
signals that display an advertisement for a product or service in the fifth area. 

1 6. The microprocessor of claim 14, additionally programmed to generate signals 
30 that link to an Internet website and display images from the website in the fifth area. 

17. A television system comprising: 

a display monitor having a screen; 
a tuner; 

35 a microprocessor configured to display television program listings in a first 

area of the screen and an advertisement in a second area of the screen; and 

means for linking an Internet website to the microprocessor to display one or 
more still images or video in the second area of the screen. 
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1 8. The television system of claim 17, additionally comprising means for linking 
an Internet website to the microprocessor to transmit the program listings for display in the 

5 second area of the screen to the microprocessor, 

19. An interactive television system comprising: 

means for receiving a television signal that carries a plurality of channels of video 
programs; 

10 a display monitor for displaying said video programs, graphics and other viewable 

information; 

means for selecting one of the channels carried by said television signal for display 
of a video program on said display monitor; 

a memory in which multiple types of data are stored, including a data base of 
1 5 television scheduling data and a data base of advertising information; 

means for storing said data base of television scheduling data and said data base of 
advertising information in said memory; 

means for simultaneously formatting and displaying said television video program, 
said television scheduling data as an on screen electronic television program guide, and said 
20 advertising information on said display monitor; 

means for selecting one of the displayed program titles from display of said on screen 
electronic television program guide for display on said display monitor; 

20. The interactive television system of claim 19, wherein the data base of 
25 advertising information further comprises: 

packets of data relating to the product being advertised, including graphic data, and/or 
textual data, and/or video data, and/or audio data; 

timing and correlative relationship data defining presentation and formatting 
relationships, sequencing, and timing of said graphic, textual, video, and audio data. 

30 

21 . The interactive television system of claim 20, wherein said simultaneously 
formatting and displaying means further comprises: 

means for displaying in a first fixed position window on said display monitor the 
video signal carried by said selected channel; 
35 means for displaying in a second fixed position window on said display monitor the 

advertising data in viewable form. 
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22. The interactive television system of claim 2 1 , further comprising: 

means for identifying a plurality of addresses for data sources, including data source 
5 addresses on a computer network such as the Internet or the World Wide Web, with data 
related to said advertising data; 

means for selecting one or more of the said identified plurality of addresses for data 
sources with data related to said advertising data; 

means responsive to said data source address selection for establishing a link to the 
1 o corresponding data source, including data source addresses on a computer network such as 
the Internet or the World Wide Web; 

means for displaying data from a plurality of said selected data source addresses on 
said display monitor in viewable form. 

1 5 23. The interactive television system of claim 21, further comprising: 

means for collecting data pertaining to viewer interactions with the television and with 
v ^ f /!^ the EPG, including but not limited to viewer television watching characteristics, viewer 
1 y r \ ^ - selections from the EPG, viewer interactions with the Internet, and/or viewer interactions 
with the television remote control device; 
20 means for storing said collected viewer interaction data. 

24. The interactive television system of claim 23, further comprising: 
means for customizing the content of advertisements in the on screen EPG display of 
advertising data according to said collected viewer interaction data. 



25 



25. The interactive television system of claim 23, further comprising: 

means for customizing the timing and scheduling with which advertisements are 

presented in the on screen EPG display of advertising data according to said collected viewer 

interaction data. 



30 



35 



-49- 



WO 99/04561 PCT/US98/I5093 

1/12 



C\J 



00 ^f- 



o 



CD 



CN 

m 



o 



V 



CD 



X 

o 

I 



f 



1° 

> >- 

z - 

— (/) 

O uj 
£ z 

39 

< Q. 
2 

O I/) 

°"y 

< 5 

00 S . 

u 0l/) 

^ O Q 

CLP < 



o 
o 



0. 

o 
o 



o 
m 
< 



UJ 




Gi- 
ro 
o 



o 



Q- 



rr O 

^£ 

%s 

O ^ uj 

2 r> 2 
a. > o 

CO 

o 



7 



O 



< 



2 



B 



SI 



CM 



7 



CNI 



o 



o 

<: 



Q_ 



B 



9 I 



CD 



7 



SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 PCT/US98/15093 

2 / 12 




SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 



3 / 12 



PCT/US98/15093 




SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 



4 / 12 



PCT/US98/15093 




SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 rCT/US98/15093 

5 / 12 




SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 



6 / 12 



PCTAJS98/I5093 




WO 99/04561 



7 / 12 



PCT/US98/15093 




SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 



8 / 12 



PCT/US98/I5093 




WO 99/04561 



9 / 12 



PCI7US98/15093 




SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 



10 / 12 



PCT/US98/15093 



O 
(Z 
O 
O 
UJ 

en 
O 



o 



o 
m i— 

op? 
EE< 

2:^ 



o 



o 
cr 
o 



o 

<C CO < 

uj r; 

S too 



u 
u 



CL 
O 
O 



m 
< 



m 



UJ 

> 



o 

CD 
CD 
G> 

Q) 
X> 

O 
O 

CO 
_D 

Q_ 



o 

CD 



— LU 

7 0(/)H 
-Oh> 

I — Q_ — 

,cruj — <<> 
Q-zZclCL^ 



LU 
CL 
< 



LjJq_ 



O 



X 



Q_ □_□_<<< 
OOOlOlOlO 
OOrOOfOO 



<< 
mm 



002: 

>-LU 

■ ■ oo>- 
2: Q_<c 

<CLUCD^><C 
LxJQ^LxJO^ 

zncLcr.ni'O 



<<<<< 
moooo 
nonoo 



CNCN 



CMhOCOCO|\CO 



o 

• • 

o 



LU 

Q 

o ^ Cj 

Q_ 

ft 5 " 0 



o 



CD 



2 

o 

I 

CL 
CO 

Q 



0 



CNJ 



o 

CD 



O 

§ 

CL 
CO 

O 



s 



SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 



11 / 12 



PCT/US98/15093 



Q 

a: 
o 
o 

Ld 

q: 



x 
o 



LU 




UJ 

Of 

2 CO 
Z) < 

coy 

^ o 
oi 

o 

2 CO 

|i 

O < 
O 2 

2 2 

yo 

<s 

I — to 



o 

2 Ld 

OO 
OS 

CO 

ce x 
u h- 

Ld Q 
Ll. Ld 
ZjO 
2 

Q > 



. Ld 
— 1 Ld 

Oul 
o 

i-o 



Lu O 

oz 



CO o 

O Ld 

x m 



Q CO ' == 



I — CO 
CO =p 



Ld 
X 



CO 

o - 

Ld 
OH 



Ld 
O 
2 
Ld 
O 
CO 
Ld 



<Ld 
.X 
Q 

2 X 
< O 
CD 3 
CO o 

if. 

• < 

X lj 

S3 



O ,— 



CO . 

, CO 
-^Ld 

< o 

Ld -r 
Q 



I — 01 
2^ 
Ld X 

9 ^ 

> J 

Ld q , 



CO 

o 



CO 
CO 



< 

Q_ Ld 
X 

is 



Ld ^ ^ x . 

f x 
o 

CO 

— CO 



O Ld . 
2 (/)£ 
Z> 

Ld O — I 

o x =J 



^ j- z 
: -LU?...? 



Ld 
01 U. 

sp 

OL 
0_ O 



Ld q: 

< 5^ 
x£ 

OP 



CO 




s 



SUBSTITUTE SHEET (RULE 26) 



WO 99/0456 1 PCT/US98/1 5093 

12 / 12 



Q 
OH 
O 
O 
LU 

a: 



i 
o 

O 



65 




Q 
UJ 

o 
< 

CO 
UJ 
h- 
Z> 



O 
CO 



CO 

< 
< 

UJ 

>- 

X 
I — 

o 

CN 

Q 
UJ 



CO 
CO 



>- 

CD 



UJ 
X 



O 



o 
if) 

s 

CO 

K- 
CO 



UJ 
Q 
UJ 
O 
UJ 

cr 

CL 



uj 
o 

Lu 

uj 

CL 
CO 

o 



oh < 

UjLiJ 
CO 



o 

CO 

< 

UJ 

CO 



o 



si 

a: a. 
< 

CO 

>: uj 



en O 
few 

26 



LU 
O 

co Lu 
5 o 

LU CO 
LU U 

^9 
2 < 

.LU 
CO 

I— LU 



LJ 
-J 

m 

< 



UJ 



q: 



X 



UJ 

> 



. UJ 



CO 

CL ^ 2 O LU 

202 CCx 

<h-U<0Dh- 



£5 
O 
CO p 

yLo 

3 LU 
2 > 
F= Z 
2 

OLl. 

00 



O 
X 
LU 
CO 

z> 
o 

a: 

o 
_i 

is 



CO 
LU 
_J 

Lu 
O 
£T 
CL 

O 
2 
< 



05 



lO 



o 



Q_ 



<: o a: 

O Lu 
-J LaJ CD 

a. q 
co > n: 

a: 



O 



< 



2 

O 

§ 

CL 

CO 

o 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCTAJS98/15093 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :H04N 5/50, 5/445 

US CL :348/73 1.734. 569 
According to International Patent Classification (IPC) or to both national classification and IPC 



a FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 348/731. 569. 563. 564, 565. 734. 906. 7. 10. 12. 13; 455/6.2. 6.3. 5.1, $2 



Documentation searched other than minimum documentation to the extent that such documents arc included in the Gelds searched 



Electronic data base consulted during the international search (name of data base and. where practicable, search terms used) 
APS 



C DOCUMENTS CONSIDERED TO BE RELEVANT 



Category' 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



Y,P 

Y 
X 



US 5,734.853 A (HENDRICKS ET AU 3 I MARCH I 998. COL. I 
& 2, AND FIG. I . 

US 5.585.866 A (MILLER ETAU I 7 DECEMBER 1996, FIG. I. 
US 5.650.83 I A (FARWELL) 22 JULY 1997, FIGS. 3-5, I 5 



1-25 

19-25 
I 7-25 



| [ Further documents are listed in the continuation of Box C. | | See patent family annex. 



* Special categories of cited documents: 

"A* document da fining the general slat* of the trt which U not considered 

lo b« of particular relevance 

"E* earlier document published on or a fur the tnleroatiooel filing date 

"L" document which may throw doubts on priority cUw>(i) or which u 

cited lo establish the publication date of another citation or other 
special reason (as specified) 

*0" document referring to an oral disclosure, use. exhibition or other 

means 

*P* document published prior to the international filing date but later then 

the priority data claimed 



later document published after the mteroatioaal filing dale or priority 
date and not in conflict with the application but cited to understand 
the principle or theory underlying the invention 

document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive step 
when the document ii taken alone 

document of particular relevance; the claimed invention cannot be 
considered lo involve an inventive step when the document is 
combined wuh one or more other such documents, auoh combination 
being obvious to • person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 



13 OCTOBER 1998 



Date of mailing of the international search report 



01 DEC1998 



Name and mailing address of the ISAAJS 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C 20231 
Facsimile No. (703) 305-5899 



Authorized officer 

WESNER SAJOUS 
Telephone No. (703) 308i-'5857 




Komi PCT/1SA/210 (second sheclXJuly 1992)* 



INTERNATIONAL SEARCH REPORT 


International application No. 
PCT/US98/15890 


A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :H04N 7/10 

USCL : 345/327. 348/2 
According to International Patent Classification (IPC) or to both national classification and IPC 


a FIELDS SEARCHED 


Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 345/327, 348/2. 1. 906, 554, 7-13. 


Documentation searched other than minimum documentation to the extent that such documents are in eluded in the fields searched 


Electronic data base consulted during the international search (name of data base and. where practicable, search terms used) 


a doc 


HJMENTS CONSIDERED TO BE RELEVANT 


Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


A 
A 


US 5.5 19,433 A (LAPPINCTON CTAL) 21 MAY l©96, HOURE9 1- 
US 5,758,257 A (HERS etal) 26 May 1998, figures l-M . 


1-13 
1-13 


Further documents are listed in the continuation of Box C. (_ | See patent family annex. 




Special cau S oriea of eit*i documanU: »r ktaf documtnl publiibod tfor tha tntaraational filing data or priority 

•E" aarliar tfoowaanl publabad oa or afW tha inUmttional film* <Ule *** docum«nt of particular relevant*; (ka claimed invention cannot bo 

cotuidared «or*l or cannot be cooatdered to tnvolva an tnvantiva tup 
*L* document whtcb may throw doubu on priority claim (i) or which m whan the document ia taken •tona 
ciud to aaUbltab (ho publication data of another citation or other 

•pocUl raaaoa (aa apaoifiad) "V* dooimunt of paxticuUr relevance; lh« claimed invention cannot bt 
. coojtdorad to Involve an inventive atep whan the doouraent ia 
O doouaeot refemna to an oral diicloiure. we. ajthibitioo or other combined with one or mora other auch doouraenU, auch com bint lion 

bebia; obvious to a poraon akilled in the art 


Date of the actual completion of the international search 
26 OCTOBER 1998 


Date of mailing of the international search report 

19 NOV 1998 


Namo and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box per 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 


Authorized officer y^l 

MATHAW Ff V>JV^1^^ 

Telephone No. (703) #5-9703 



Form PCT/ISAV210 (second sheetX'uly 1992)* 



